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It THE ISSUE 



Goal #1 * In the policy paper of the Office of Career Education (1974) , 
nine learner outcomes ware established— a tenth was added later. Ori- 
ginally they were presented in this context i 

For purposes of forming a broad basis for evaluating the effectiveness 
of career education efforts^ a listing of developmental outcome 
goals is essentials In this sense t career education seeks to produce 
individuals who p when they leave school (at any age or at any level), 
are? (1) Competent in the basic academic skills required for 
adaptability in our rapldly^changing society , 16 (Emphasis added) 

Other goals dealt with such outcomes as,,, good work habits**, work 
values.,, decision-making* job-huntings and job-getting skills,.* occupa- 
tional and interpersonal skills,,, self-understanding and understanding 
of educational-vocational opportunities,., success in placement in a paid 
occupation f education* or vocation.** seeking to find meaning and meaning- 
fulness through work in productive use of leisure time,,, awareness of 
means available for changing career options,^ 

None of these outcomes are unimportant* In fact, for understanding the 
impact of career education (CE) , all must be looked at concurrently, While 
goal #1 was isolated for the purpose of this analysis, it is essential 
to view them in context with one another, They cannot easily be separated. 
However, as the recent national survey on CE pointed out, among the learner 
outcomes indicated, the one clearly perceived in the field as the most impor- 
tant was the teaching of basic skills, ^ 
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What othershave said about CE evaluation * It is not that this analysis 
needs a whole lot of additional justification. We have to look at learner 
outcomes if we wish to assess the effectiveness of CE; if we look at 
learner outcomes . we have to look at basic academic skills* But, to be 
sure, what others have thought about this issue is essential for under- 
standing not only the impact but the nature of CE, 

We begin, therefore, by citing a U.S. General Accounting Office report 6 
which recognized that "Before State and local educational agencies can 
consider career education curriculums, they must know*** the expected 
effect on students." Review by the GAO of some of the early projects 
provided inconclusive results regarding impact. (These were the projects 
funded under authority contained in the Vocational Education Amendments 
of 1968 , The Cooperative Research Act. and the Education Amendments of 
1972,) GAO found that evaluations were hindered by the lack of adequate 
measures and by difficulties with specific test instruments. However f it 
concluded that some evaluations * "though subject to the limitations in the 
art of measurement, have shown a favorable impact," 

Another early report (1974 i£ relatively early in the life of CE) . summed 

up the evaluation problems t 

As with any proposed educational program., the question 'does it make 
any difference in student learning? 1 must be addressed, In the case 
of career education this question has not been adequately addressed 
to date. Part of the reason lies in the newness of career education 
programs, Another reason is that many of the outcomes of career 



6 



-3- 

education are long range,., and thus cannot yet be measured, A 
third problem is that instruments of sufficient validity and relia- 
bility do not exist in many of the areas which career education 

addresses, Finally, evaluation is expensive and requires considerable 

7 

expertise, 

In the case of basic academic achievement, it is clear to see that some 
of these point's apply. This type of evaluation is expensive s it does 
require considerable expertise, and it does raise a validity question. 
Further, the question of the relationship between the infusion of CE 
into the curriculum and basic academic achievement is a legitimate 
area of concern. 

Dr. Hoyt's position , Kenneth Hoyt, director of the Office of Career Educa- 
tion , has considered this relationship in a number of articles and speeches. 
He has stressed the importance of Goal #1 for a number of reasons 7 including 
these! employers complain that youthful job applicants are often deficient 
in such skills; moot persons will be forced to change occupations several 
times during their adult lives and need basic skills as a prerequisite for 
doing so; many pupils apparently are not sufficiently motivated to acquire 
these essential skills. 

Although obviously many opportunities to learn and use basic academic 
skills exist between elementary school and the time one applies for or 
changes a jobs Hoyt is correct in reminding us that the foundations are 
set early in one's school life. He also identified two broad approaches 
for, increasing achievement at the elementary school level! show pupils 

7 
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how adults need and use such skills and increase the variety of means 

21 

and settings for use in helping pupils acquire these skills. 

Evaluation of academic achievement is of highest priority to Hoy t f as he has 

stressed clearly and unequivocally % 

Unless career education can demonstrate that, when applied, pupils 

in elementary schools increase their levels of academic achievement 

in the basic skills, it will have trouble justifying itself long 

21 

enough to be concerned about the remaining criteria. 
And again i 

. . -career education should not be afraid to use traditional 
evaluative criteria—including increases in pupil achievement, in 
pupil attendance, and in school-holding power. Of theses demon- 
strations of the ability of a career education approach to increase 
pupil achievement in the basic academic skills is, by far* the most 
crucial, While preliminary evidence available suggests that career 
education can have such an effect, this evidence is, at present, 
far too sparse and too susceptible to criticism for us to claim that 
career education, if properly applied, will produce such results, 
With the current strong national push toward a 'back to basics 1 
emphasis * it seems to me especially crucial that comprehensive 
career education efforts demonstrate that , in fact, they can serve 
as an effective vehicle for improving basic academic achievement, 
I am not afraid to use this criterion providing a truly comprehensive 

career education effort is being applied* I am very fearful of 
using it with some of the efforts now being called 'career education 5 
that exist in many schools, 20 
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In response to the argument that more rigorous standards — and not CE — is 
the way to raise achievement , Hoyt has stated that CE f? would answer this 
objection by pointing out that,-, advocates have claimed this is to be 
one approach to increasing student achievement but never the only possible 
approach 

In a recent analysis, Hoyt has developed a number of concepts further relating 
to the question of whether or not CE is willing to be evaluated—in part 
at least — on the basis of its demonstrated ability to improve academic 
achievement , He has stated that l? Xf that question is answered affirmatively, 
then it is obvious that the primary implementation focus must be oriented 
around the teaching/learning process with the substance of "careers" being 
used as a vehicle for doing so , Hoyt then discussed four generic kinds 

of changes! 

, * , (a) a sense of purposefulness , (b) rewards for accomplishments, 
(c) increasing variety, and (d) full utilization of all available 
resources—are ones that have been shown to increase industrial pro- 
ductivity* There is every reason to believe that they can also be 
used to Increase educational productivity— i. e, , academic achievement. 
Unless we can demonstrate that a career education approach improves 
academic achievement, career education will fail as a reform effort. 
The teaching/learning process, not the substance of careers, is the 
basic ingredient in improving academic achievement* 

The basic issue's,,, is whether or not increases in academic achieve- 
ment represent a reasonable criterion for use in evaluating the 
effects of career education. If it is, then curriculum/instruction 

9 
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specialists become fully as important as career development 
specialist s in implementing career education. If it in not, then 
career education Is merely an extension of career development, not 
an educational reform movement. As we move from conceptualization 
to implementation, this issue must be faced and resolved ^ 

Elsewhere, Hoyt has suggested that each of the changes mentioned above 
is designed to help improve academic achievement and that "none is, in any 
way, counterproductive to attainment of any of the basic goals of American 
education. 

Lastly, on whether GE takes time away from teaching the basic academic 
skills, Hoyt has responded; "Career education, far from being opposed to 
the 'back to basics 5 movement, can and is serving as an effective vehicle 
for assuring that students acquire such skills* The changes in the 
teaching/learning process advocated by career education are each designed 
to increase academic achievement, not to interfere with this goal. 

The evaluation mini-conferences . Between September 1975 and May 1976, 27 

mini-conferences were conducted on nearly every conceivable phase of CE t 

The two which dealt with evaluation offered a number of insights into the 

issues of Goal #1* A detailed summary of these conferences has been 
19 

presented by Hoyt* Since many of the discussion points have great 
relevance, they are reported below in some detail: 

(1) Since CE assumes efforts which begin in the early elementary school 
and continue through the entire system, the attainment and measurement 

10 
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of long-run goals must necessarily be delayed for a number of years. This 
accentuates the importance of both process and short-term product goals* 

(2) There was diversity of opinion among conferees as to what would be 
considered acceptable measures to determine the extent to which students 
have acquired such skills, 

(3) Many current attempts at evaluation have concentrated their primary 
attention on "Step c" — assessing the benefits that result from application 
of the treatment, while almost completely ignoring "a and b," i,e s , 
specifying clearly the treatment to be applied and verifying the extent 

to which it has been, 

(4) On evaluating implementation of a concept! If CE continues to be 
viewed as a concept which, when applies in action, can lead to both 
educational reform and to a series of direct student benefits, we will 
continue to be in a position where the total success of the effort can 

be evaluated, but great difficulty will be encountered when either praise 
or blame is to be assigned to a particular segment, Evaluation would be 
much easier if CE were a program, but it is not, 

(5) On evaluative criteria! Because CE seeks to be infused into all 
programs rather than added on as a separate one, because it does not seek 
new kinds of specialists at the building level, and because it does not 
ask for large amounts of dollars s its long-run future may, operationally, 
depend relatively more on personalised, informal criteria than the more 
formal evaluation efforts based strictly on either process or product* 

li 



(6) Additional points on Goal 01: (a) A clear majority, but not all, 
of the conferees considered this to be a reasonable goal. In the view of 
the Office of Career Education, this is the single most important goal for 
CE, as a vehicle for educational reform, A proposal for educational reform 
that ignores this cannot, in the Office of Career Education 1 8... opinion, be 
justified* 

(b) While most of the participants agreed on the appropriateness of this 
learner outcome goal, they disagreed on the kind of measures appropriate 
for use in measuring progress toward it. In the first of the mini- 
conferences, consensus seemed to exist that norm-referenced tests are 

what the general public wants and, thus, what should be used* A significant 
minority, however, argued strongly for use of criterion-referenced 
achievement tests. General agreement was present that norm-referenced 
tests have serious limitations and probably will be replaced with other 
approaches to measuring academic achievement, but most felt them to be 
more appropriate than criterion-referenced tests at the present time. 

(c) In the second mini-conference f discussion centered around the 4 
potential which newer approaches to measuring functional literacy have 
for assessing this learner outcome* A general consensus seemed to exist 
that, while standardized norm-referenced tests may be suitable for use 

in assessing this outcome for elementary school pupils, a measure of 
functional teraey would be preferable at the junior and senior high 
school levels. 
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(d) In the view of the Office of Career Education, the use of norm-ref ereneed 
teats are appropriate, at tl\l$ times for use at both the elementary and 
secondary school levels in a^f easing this goal. In addition, at the secondary 
school level, use of some kind of functional literacy measure should be 
encouraged* Die of such measures, as a replacement for norm-referenced 
tests at the secondary school level, will become possible only when academic 
teachers at that level accept such measures as valid indicators of what ~ 
they are teaching* It appears that this will not happen in the immediate 
future* 

The monograph concluded with reiteration of the idea that "Product evalua- 
tion, based on a clearly defined set of learner outcome goals, will be 
essential in assessing the extent to which the career education effort is 
providing direct benefits to students." 

What others have found * There have been other analyses of GE in relation 
to academic achievement. For example, as part of a study commissioned by 
the National Advisory Council for Career Education, Rita Bryant reviewed 
20 studies including several indirectly related to the topic (i*e., those 
with factors regarded as contributing to academic achievement, such as self- 
esteem, self concepts, and motivation), Bryant f s conclusion seemed to be 
that s 

Indications are that the evaluations of many 1975-76 programs may 
contribute substantially to the knowledge now available concerning 
the interrelationship of career education and academic achievement. 
Soft data have indicated that positive changes in the self concepts 
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and work habits of some students have taken place. Follow-up 
studies, indeed, may net more hard data that career education can aid 
the development of students 1 acquisition of the fundamental skills — ' 
reading, writing, and arithmetic, 3 

Thomas Inderleln, as a 1975^76 Fellow in the Office of Career Education, also 
reviewed a number of studies which dealt with several aspects of CE, He 
included a brief analysis of 13 studies on academic achievement, many 
^of which were cited by Bryant. Enderlein's conclusion: 

Perhaps the most encouraging findings were reported in those aspects 
of the evaluations which focused upon basic academic skill develop- 
ment, Where the career education concept is infused into existing 
curricula, it appears that this infusion process positively relates 
to academic growth, 

Robeyt Worthington, in another study commissioned for the National Advisory 
Council for Career Education, reviewed 49 doctoral dissertations relating 
to various aspects of CE, Of that number, he reported that none placed 
emphasis on the specific learner outcome of basic academic achievement. 

There obviously have not been many studies relating CE to academic skills, 
This was also a conclusion of the Demiopraent Associates in their evaluation 
of vocational exemplary projects and guide for evaluating CE, Of 20 reports 
anmlyied in 1975, only one addressed itself— in part — to academic competence, 11 

Some of the initial articles in this area offered sketchy Information which, 
while supportive of CE, can not be classified as comprehensive research. 
One item to which several writers refer is a study by Pureell, Hoyt 

14 
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has reported on iti "...when the reading ability of 2nd graders from a 
class emphasizing CI approaches was compared to that of 2nd graders not 
involved in such an approach, the reading scores on the Cooperative 
Primary Reading Test were significantly higher, in a statistical sense, 
in the class using a CE approach..." 21 The original source, a project n 
letter, contained the following note: "These are only preliminary findings, 

but they seem to support the contention that CE treatment, or at least 

' , tf21 

the novelty of the treatment, is having some positive effect on students. 

In Dade County, Florida, a 1974 letter from Superintendent Whlgham to 
Dr. Hoyt provided data on results obtained from efforts to use a CE approach 
to teaching math. Comparing gain scores from data collected in 1973 and 
1974, Whigham reported mean gains (grade equivalent) for 4th graders at 
il.96, 5th graders at M.52, and 6th graders at M.30. Hoyt also noted 
that conversations with school personnel made these gains seem even more 
impressive when they related that among other inner-city elementary schools, 
the average mean gain in math for the year was less than .50 (grade 
21 

equivalent) . 

More recently, four FY * 75 projects of the Office of Career Education 
touched upon the relationship between CE and academic achievement. Those 
with "hard data" are included in this analysis, but two observations also 
are reported for two other projects: 

• Evidence in relation to Goal #1 is found in a report submitted by 
the Indiana State Department of Public Instruction (USOE Grant 
No. G007502396), The document reports, among other activities, a 
program developed by the Lakeland School Corporation. The program 



was provided to approximately 40 eleventh graders who exhibited hard 
core reading problems, All of them had histories of repeated failures 
and the expected concurrent negative attitudes toward anything 
'academic. 1 A teacher and an aide were able to achieve dramatic 
reversals in attitudes and skill increases by using a variety of 
career-related approaches, guest speakers and informational film- 
strips. The results were so encouraging that the school board main= 
tained the program as a continuing activity supported entirely with 
local funds , ^ 

In Rockford, Illinois (USOE Grant No, G007502397) teacher interviews 
were conducted with questions on listening, speaking, reading and 
writing skills, and on arithmetic operations,, problem solving and 
measurements skills, The design included a control group of 
teachers not involved with CE and an experimental group who infused 
GE only in language arts and measurement in math, Almost all cases 
wf teachers observed increases in communication skills occurred in 
classrooms with high infusion, Teachers reported that Integration 
of CE concepts had a definite impact on achievement in communication 
skills, especially writing, Marked improvements were noted in form, 
content, organization, and clarity of written material and vocabulary. 
The greatest improvement was found in poor or remedial students. 
Improvement also was noted In reading habits and interests, attributed 
to new interest sparked by career exploration* Little Improvement 
difference was found between experimental and control groups in math 
skills, except in the area of measurement, which was the only math 
skill in which CE activities were integrated, 32 
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Whai: others have felt . The purpose of this analysis is obviously not to 
dwell on what educators and laymen feel about CE, It is important to 
note, however, fear on the part of some who claim that CE will adversely 
affect the teaching— and learning — of basic academic skills. On the other 
hand', there is an ample support for CE and what it can do for basic skills— 
if properly implemented, 

The Council for Basic Education, while not having a formal position, has 
commented with some frequency ever since "mis new form of enlightenment 
was given a place on the list of education schools are expected to 
provide." Although they have "never voiced unalterable opposition," they 
consider themselves "doughty skeptics" and have been extremely candid in 
expressing misgivings about the alms in CE. The Council believes ",,,that 
it is appropriate for the schools to take some responsibility for acquainting 
students with the 'world of work. 1 How much is a question, however. Cer- 
tainly not so much that it takes precedence over responsibility for basic 
education, We suspect that sometimes, if not often, basic education is 

i_ , „10 
the loser," 

The Council of Chief State School Officers 1 position lists the steps which 
it believes should provide learners with opportunities to acquire among 
other things, "the basic skills essential to all other learning," The 
statement goes on to say that the CCSSO believes that CE will provide a 
vehicle which can lead to the accomplishment of this purpose. 

The National Education Association in its official 1976 resolution supported 

29 

CE but did not specifically address the issue of academic skills. The 
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American Federation of Teachers in its 1976 resolution stated that it 
recognized "the potential misdirection of some well intentioned education 
and work program!." 24 However, while neither ATI's resolution nor its 
Task Force pa 4 tr addressed the issue of academic skills, its Congressional 
testimony raised the issue when discussing declining standardized achieve- 
ment test scores t 

While there is no evidence to indicate specifically or conclusively 
that career education programs are even partly responsible for this, 
it seems more than simply coincidence that emphasis on career educa- 
tion as well as other non-traditional curricular areas is rising 
while achievement test scores are falling. 

Assuming that tests are measuring what we want them to measure, 
and assuming that English and math should and will continue to be 
basic elements in any solid curricula, we think this committee may 
want to address Itself to the very real question of whether career 
education programs supplement or substitute for basic curriculum. 23 

Another labor union, the United Auto Workers, took a position which in 
some respects paralleled the CCSSO in that it listed a number of major 
educational problems, including the "failure of students to acquire and 
possess vocational, technical and academic skills," and then went on to 
state that "career education, properly implemented, addresses itself to 
correction of these problems," 36 



Some researchers' notes on CE evaluation and related 



concerns < 



(1) Gordon Cook and others t In any situation involving evaluation, there 
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are usually at least two schools of thought* One focuses on precision and 

proof "hard data — while the other concentrates on self-actualization and 

8 

the free play of natural forces* 

(2) Young and Schuh i Generally speaking, it is preferable to select the 
design which permits answering each evaluation question with the greatest 
possible confidence. Since the most confidence can be placed on answers 
based on the research designs of controlled experiments, if it is necessary 
to ? preve f something (e.g., that career education increases reading achieve 
ment scores), then true experiments (with control groups) are necessary. 
Although there are several 'true 1 experimental designs which can be used, 

a major problem in the design of education program evaluations occurs 

when the requirements of these f tiue 1 designs cannot be met, In a school 

setting, the most troublesome requirement is to randomly assign students 

38 

to program activities (treatments), 

(3) McCaslin and .Lave ; On standardized tests! 

Advantages - Disadvantages - 

Data are quantifiable and can be Norms may not be appropriate 

easily compared over time, for on- for a given population; tests 

going assessments; data can be related may be inappropriate for the 
to goals or objectives; groups of goals used; if too much reliance 

students may be compared, on test, other data and values 

may be overlooked; usually re- 
flects only cognitive achievement 

(4) Lucas: Let there be no doubt about it, evaluating the impact of 
career education on student behavior is a difficult and expensive job,,. By 
looking at the percentage of available instructional time spent on career- 
related activities, one can better anticipate the magnitude of student 
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behavior changes. If only a small percentage of instructional time is 
spent on careers, could one expect large changes in student behavior? 
Not likely, and in this case the failure to find significant changes in 
student behavior would not indicate the ineffectiveness of a program's 
components. It would only indicate a failure of the delivery of program 
components . (Emphasis added) For a product evaluation to have meaning, one 
must be sure that the program was delivered as planned. Therefore, the 
prerequisite for a valid product evaluation is a solid process evaluation 
which quantifies program delivery. 

To increase the probability of a positive product evaluation, one should 
make sure that the program is delivered with adequate force to students 
in the target population. 

This recommendation presents a dilemma, because one of the best ways to 
turn off a teacher is to Impose on him/her a new concept (like career 
education), new teaching methods, and require that he/she devote a major 
portion of their instructional time in these activities before the teacher 
has been convinced of the value of the new program. ., .by forcing teachers 
into something they have not had time to study and accept or by not 
maintaining tight administrative control over program delivery, positive 
product evaluations are not likely. 

The solution to this dilemma is to delay product evaluation of career 
education programs until teachers and administrators have been convinced 
of its value and are willing, able, and do implement the experimental 
program to its fullest degree. This takes years! 25 
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(5) Lucas > again ; Another shortcoming (for program evaluation purposes) 

of many commercially available teats, and this is particularly true of 

standardized achievement "te^ts , is that they are norm-referenced tests. 

According to Pophami 'There are, indeed, a number of situations in which 

norm-referenced tests (particularly If their cultural bias problems are 

cleaned up) can prove very serviceable. Evaluating the quality of an 

educational program is not one of those instances* , * .After several 

revisions $ in fact* a standardized achievement test looks and functions 

very much like a standardized intelligence test. Such tests are relatively 

insensitive to instruction* ' Because of the relative insensitivlty of these 

tests, changes in student behavior resulting from a career education program 

25 

may not be discovered. 

Notes on how this analysis proceeded, 

(1) On the Data Chart I used^ for the most part, the exact langu age 

of the researcher so that the reader would have the precise flavor 
of the report rather than a second-hand interpretation. My own 
comments in that section have been kept to a minimum and are indi- 
cated by the use of brackets. 

(2) I have attempted to write for the laymen (i.e. , most of us) rather 
than for practicing researchers, The Data Chart, however, includes 
a column on statistical analysis and addresses indicating where the 
report can be secured for those who wish to search further into the 
raw data, 

(3) I have used the primary resources In all cases* The original 
reports were received from various resources, An ERIC search conducted 
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by the NIE assisted in the identification of sources. No material 
was incorporated second-hand into the Data Chart unless indicated. 
(Unfortunately s obvious restraints prevented me from reviewing the 
data at the direct source—in the field— which would have been highly 
desirable. For more detailed reporting , future analysis should attempt 
to study the data at the site 9 particularly data on CE treatment, 
A cape study approach which would look at basic academic achievement 
in the context of all of the other learner outcomes also is highly 
recommended,) 

A total of 38 studies—from the early to mid-197G f s— are Included in 
this analysis. 

The previous descriptive analyses of research in this area seemingly 
gave equal weight to the scope of the studies and often failed to 
provide sufficient information (e.g. » on the instruments used, size 
of sample, treatment. Interpretations % etc). The format here, 
hopefully, allows readers to see for themselves the dimensions 
of each project and to draw their own conclusions. 

Much of the data in the reports dealt with many other learner outcomes. 
However, for the purpose of this analysis $ the focus was narrowed.. 
(Nevertheless, for complete understanding of CE impact — and it is 
sizeable— it is essential to study the reports in their entirety, 
Basic academic skills are just one of the learner outcomes and, as 
indicated 9 must be viewed in context with all of the others,) 
Research along these lines appears to be in its infancy. The situa- 
tion in this area is fluid, i.e. , undoubtedly there are additional 
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data available "out there," Probably many local studies exist 
which report information on the basic skills, (We would* therefore 
be most grateful if you would send your reports to the Office of 
Career Education—to the attention of the Deputy Director,) 
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II. THE FINDINGS 
Five general observations. 

(1) With the acknowledged diversity of the concept, it was not surprising 
to discover that there did not appear to be a common operational defini- 
tion of the terra, career education. 



Many problems in CE evaluation have been identified. Those cited 
above were clearly evident to this observers long-range objectives are 
often difficult to measure, evaluation does require considerable expertisu, 
and experimental designs are often difficult to maintain in public school 
settings. 

(3) Unfortunately, detailed CE treatment was not always clearly stated; 
it was not always possible to ascertain the degree of "delivery of program 
components . " 

(4) The scope ofi these studies varied greatly—from the assessment of 
one teacher to the comprehensive reports of the R and D labs. 

(5) The quality of the reports also varied. By and large the studies 
speak for themselves. Some say much; others say very little, A few 
studies were poorly designed; a few reports were poorly written. 

Subject matter focus. The majority of the studies focused on mathematics 
(28 studies) and/or reading (23), However, data also was reported on 
language arts (14)— including spelling, vocabulary,, "English," and oral 
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and written communication, studies skills (4) > social studies (3), 
and science (2) . The subject matter focus of several studies (6) were 
unspecified * 

Project locations . The studies were conducted nationwidei in the 
Northeastern States (17 studies), Southern States (8) s mid-Western States 
(9), and far-Western States (4)* However* some of the studies of the R and D 

labs covered several sites, e.g., one of the studies of the Northwest 

... * 

Regional Educational Laboratory had pilot sites in Oregon, Washington, 
Montana, and Alaska and one of the studies of the Appalachia Educational 
Laboratory had implementation sites in Georgia, Louisiana* Iowa, and New York, 

Research designs > Procedures varied greatly* The use of pre-tests and 
post-tests were indicated in the majority of the studies (25) ; the use 
of control groups were indicated to the lesser degree (13) • Three studies 
specified utilization of a true experimental design (Gibboney, the RBS— 
9/26/75, and Blester)* three indicated a quasi-experimental design 
(Olson, Omvig f 76, Kershner and Blair); three cited the specific research 
design indicated by Campbell and Stanley (Olson, Bryant* Omvig ! 74). Other 
studies indicated the following approaches i the use of comparison groups, 
treated and untreated comparisons, comparisons of norm-reference test 
data, the use of achievement tests over an extended period (as well as 
shorter periods), the comparison of GE to pre-CE classes, and the compari- 
son of test scores from one year to the next. 

In struments , The most widely used standardized test was the Comprehensive 
Teat of Basic Skills (14), Other tests used to a lesser degree were the 
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Metropolitan Achievement Test (4), The Stanford Achievement (4), the 
Iowa Test of Basic Skills (3) and the Iowa Test of Educational Develop- 
ment (3)* In addition, a number, of other tests were used (13) as well as 
several criterion-referenced measures (4)* One study did not specify 
the instrument* 

Size <*f sample. It would be meaningless to cite the average number of 
students involved in these studies or to generalise here, except to say 
that there was great variability. The range numbered from as few as five 
to as many of several hundred, The majority of the studies specified the 
numbers in the experimental and control groups, while others simply reported 
the total amount of students involved in the program, or students tested, 
or the number per group per grade* By and large , the figures appeared to 
be significantly large. 

Grade levels . In some cases the reports indicated that the range was 
from grades 1 to 6, 2 to 6, 1 to 9, 2 to 11, or, in two cases, K to 12, 
To give some idea of the scope, the following frequency distribution is 
given— in which citations were made for each grade when a range was 
indicated: 



(level) (ft of studies) (level) (# of studies) 

K 3 G7 10 

,,.01 6 G8 14 

02 9 G9 13 

03 14 G10 12 

04 13 Gil 16 

05 10 G12 11 

06 13 Adult 1 



Statistical analysis , A variety of approaches were specified, e,g s , 
univariate and multivariate analyses of variance, analysis of covariance, 



t-test, F-ratlos* significance levels (F) , regression analyses * standard 
deviations s reliability coefficient, chl^square procedures, parametric 
statistical techniques, and criterion-referenced test. However, since this 
analysis is written for the layman rather than the practicing researchers, 
we have made, with one exception! no attempt to define the terms. Instead 
we direct the reader to standard texts on evaluation and measurement (such 
as the ones we utilized by Robert Ebel 4 " 1 and Scarvia Anderson and others, 
which explain the statistical approaches identified) . The one exception 
is criterion-reference measurement, for which Anderson and her colleagues 
stated the following, by way of definition! " . . .students scores , - .are 
interpreted in terms of rationally or empirically established standards 
of attainment rather than in terms of the performance of some reference 
group of people," As we noted, criterion-referenced measures were used 
in four of the studies analyzed* 

Delimitations of the studies . In a number of instances no delimitations 
were cited. 15 However v of these identified, the following points were 
noted with greatest frequency! problems relating to establishing controls 
groups and experimental designs (15) * problems relating to testing pro- 
cedures (6) , problems relating to procedures for implementing the CE 
program, e*g e , students did not receive a concentrated exposure (4), 
In addition, several studies (4) identified problems relating to the short 
time period covered by the project, e,g., the time required for proper 
implementation, the short intervention period, and the fact that basic 
skills take years to develop and /or modify, 
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Career edu cation treatment . In spite of the importance of the CE treat- 
ment, some of the studies were not overly generous in sharing with the 
reader the specific nature of the program, This was not true of all the 
studies, but it occurred often enough to cause some frustration on the 
part of this analyst. Nevertheless, here is what I found 

By and large, the CE treatments described in the study reflected the 
overall approach which often is presented in the following sequence: 
beginning in the elementary school and continuing through college edu- 
cation, . . emphasizing the process of career development—including career 
awareness, career exploration , career motivation , career decision making , 
career preparation , and career entry . All of these were reflected to some 
degree in the studies analyzed. 

Over half of the studies (21) indicated the development of specific 
curriculum guides, units, learning modules or lesson plans. Although the 
terminology differed, the overall process was evident. The teaching 
strategies were often refered to as "the infusion process 11 in which 
curriculum units were integrated into career information. Other related 
approaches included the use of competency-based modules, data-centered 
systems, and self-instructional packages. 

Staff development, in-service programs, and workshops of various sorts 
were specifically mentioned in a number of instances (18) , as were the 
use of community resources, field trips, or site visits (10), and "hands on 1 
experiences (8) . 
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The various studies of the Research and Development laboratories 
and of Glbboney Associates dealt with what Is often referred to as 
experience-baaed models* Those descriptions included such program elements 
as: self-paced learning resources* direct participation in a vocational 
environment* site activities integrated* with the rest of the curriculum, 
the integration of work and learning experiences in the community, direct 
experiences in a variety of community settings * and comprehensive, 
individualized learning, r 

Lastly, a word on program length % while the majority of the studies 
appeared to be for one academic year, the range was wide. Unfortunately, 
the data was sparse on this* Some of the reports were of projects which 
covered two or three program years, while others were much shorter than 
one year. Two illustrations: !, The intervention period during which 
student Instruction was provided was limited to a maximum of 12 weeks," 
and "exposure to CE programs over a six-week period," 

Highlights from the studies i findings and conclusions * The studies have 
been categorized, into eight groups. From this section, we hope the readers 
will begin to gain a "flavor" of the studies. 

Dissertations . While the N1E search disclosed numerous CE dissertations 
over the past few years, only two appeared to relate directly to the 
issue at hand, The 1973 dissertation (Feit) found no statistically sig- 
nificant differences between experimental and control groups in levels of 
reading and math in the 4th and 5th grade. In the interpretation, the 
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researcher stressed the limitations in the choice of measuring devices. 
This dissertation itself was a rather limited field study which the author 
noted lacked proper control of the experimental situation. 

The 1975 dissertation (Bryant) was somewhat more elaborate , although it 
was indicated that the length of the implemented program was only approximately 
four months and that teachers in the experimental group had no knowledge 
of CE prior to the initial orientation period. The researcher reported 
statistically significant differences favoring the experimental group* with 
most significant gains in the total test battery, vocabulary, language, 
mechanics and expression. This lead the author to affirm that the integra- 
tion of CE concepts can have positive effects on cognitive growth* 

One teac her, one middle school, and one high school , A study of New 
Educational Directions (Bagley) attempted to determine whether one teachers 
effectiveness improved after adoption of a CE*oriented approach as 
reflected in the academic growth of students over one year* The differences 
between groups in math were judged to be of no significance. In rsading 
the greater achievement of the CI group was significant (,025), causing 
the researcher to conclude that the results indicated the adoption of CE 
activities appeared to affect students 1 growth in reading achievement during 
the year they spent with the teacher, 

A study of a CI program in a middle school in Connecticut (Gagliardi) 
included the use of city administered achievement testing, Simple com- 
parisons were made which indicated that the CE group did better than the 
non-CE group in terms of improvement of grade-level .equivalence in reading 
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(a ,4 difference) and math (a ,2 difference). A city government administra 
tor reflected that while the gains were modest, they were consistent and 
supported other indicators of success* 

A study at the ' igh school level in Connecticut (Lapinsky) conducted with 
slow learners and disadvantaged youth found that students showed an average 
gain of 1.7 years (9th grade) and 1.3 years (10th grade). The 9th grade 
gains ranged from 1.0 to 3,7 years and the 10th grade gains, from ,0 to 
2*8 years. The report concluded that the program facilitated, reasonably 
well, better adjustment on the part of students to school and the improve- 
ment of basic skills ■ 

Local districts . Six studies disclosed generally favorable results in 
various ways. 

While the Ceres Unified School District study (Green and Hildebrandt) 
had some problems with contamination of the groups which had been planned 
to be the control, the findings revealed that the experimental groups 
significantly exceeded the control in 1st grade reading and 2nd and 4th 
grade math and reading. This caused the researchers to conclude that there 
was considerable evidence to substantiate that experimental students would 
score significantly higher on standardized tests than would the control 
students . 

Both the studies in Cheektowaga, New York, and Newark, Delaware, were 
similar in that while comparative scores between groups were not sig- 
nificant, achievement gains were made within the treatment groups, The 
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New York State study (Conway) used criterion-referenced instruments written 
to match objectives in CE packages. The study found that while extensive 
treatment effects could not be demonstrated, both groups showed achievement 
gain, almost without exception , between pre- and post-tests , 

In the Newark, Delaware, study (Was dyke) , the instrument also was a 
criterion-reference tool* the CE Cognitive Questionnaire, The findings 
stated that within the groups the difference was statistically significant 
at the *01 level but that differences between groups was not significant. 
The researcher concluded that if the strength and direction of the 
correlation holds with the larger number of cases in the final evaluation 
group j the relationship between mean posttest scores and exposure to 
treatment will be significant. 

In the Elkhart, Indiana, study (Morrison), which concentrated on the creation 
of teacher awareness rather than on student change, growth gains in language 
and reading skills were reported ranging from ,6 to 3,3 years, with the 
average gain 1.5 years. The researcher, however, called attention 
to the fact that the students did not receive a concentrated exposure 
to CE during the year, 
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An extensive study in Pittsburg, Kansas (Huffman) covered a period of 
several years* The second year evaluation* which ended in April 1975, 
presented a large amount of data. At the 3rd grade level, while comparisons 
between groups revealed no statistical differences, post=test scares 
showed a substantial gain for all tests of the experimental group. At 
the 6th grade levels the same was true* i P e , , no statistical differences 
between groups, but data on six tests (reading , spelling, math computation, 
problem solving* total math, science) appeared significant at the ,001 
level within the experimental group, The conclusion drawn was that the 
CE program neither enhanced nor inhibited the traditional learning process 
at these grades* Substantial growth was reported In all nine areas in 
both grades, At the 9th grade level, a different instrument was used (the 
ABLE test); the report stated that on this test the difference between 
pre-test and ' post-test distribution of scores was significant at the 
.001 level of confidence, 

The third year evaluation (ending in March 1976) in Pittsburg, Kansas, was 
similar to the previous year in that at the 3rd grade level, no statistical 
difference was evident between groups, but substantial gains were made over 
pre-test scores in all nine test areas. At the 6th grade level, the same 
was true between groups, but there was substantial growth in all 11 
test areas. For the 8th graders, it was reported that the career math 
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program had a positive effect on the performance of students, (No 
further elaboration was made.) In correspondence from Huffman (12/30/76) , 
the conclusion presented was that 11 . . .we could not show significant 
difference from the control group, but we did show continued growth in 
achievement as should be expected, and also have included many activities 
that promoted awareness, exploration and preparation including decision- 
making skills. 11 

In Philadelphia, the Opportunities Industrization Centers of American, Inc, 
study (Gibboney Associates) generated a wealth of data, The descriptive 
section of this report revealed a situation in which the interns, in 
reading, gained five academic months in an average of eight program 
months and, in math, four academic months in this period, In comparison, 
the average scores of the control students did not change* The conclu- 
sions from the report indicated that if the students can build on this 
start and continue to develop their skills, their post-GIF (program) 
chances will be fairly bright, A great deal of technical data was given 
to support the conclusions, * 

County g/s terns . Several county studies have been conducted over the 
past few years in this area. Probably the most widely cited one is the 
Lincoln, County, West Virginia, study (Olson), Olson's major findings were 
that the adjusted post-test means for the experimental group were 11% 
higher than those of the control group on language achievement and 24,5% 
higher on mathematics achievement. The researcher concluded that utilizing 
experiential activity to illustrate abstract symbols and concepts related 
to CE goals is an effective method of increasing academic achievement. 
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Stating this another way in an earlier report based on the same data, Olson 
wrote that illustrating the value of academic skills in terms of their 
relationship to the career would provide an effective vehicle for 
achieving both CE and academic subject goals* 

The Calhoun County, Michigan, study (Simpson) utilized minimum performance 
objectives developed by the Michigan State Education Department in 
mathematics. The findings for the 3rd and 4th grades supported the 
hypothesis that academic competence—measured by a math test—would 
not be Impeded as a result of treatment, In the 5th grade the report also 
indicated that academic achievement would not be impeded as a result of 
CE instruction since the experimental students performed at least as well 
in mathematics * The conclusions drawn were that the integrated approach 
does not interfere with academic learning of students exposed to this 
kind of treatment and that, in some instances, achievement may be enhanced 
by this approach. Also* in some instances when academic skills are not 
greatly enhanced (as in the 3rd and 4th grades), the approach does not 
interfere with student learning. ., (therefore) not only can it provide 
the essential basic skills at the same level as traditional teaching, it 
delivers other information and knowledge that normally is not provided in 
the latter approach* 

The Henderson County* Kentucky, study (Gibson) was mainly concerned with 
average gains per year compared with national norms* The findings re- 
vealed that in the three years of assessing data, the average score 
remained somewhat below the national norm although in the third year there 
was an appreciable gain* As in several other studies, the researcher 
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concluded that even though one could not say the program gave a tremendous 
boost t© the academic skills areas, there was no loss either. The report 
also assumed that there were concomitant gains in motivation for some of 
the students, 

The Dade County, Florida f study (Department of Planning and Evaluation) 
utilised State-wide assessment instruments, It was reported that the 
acquisition of reading skills were somewhat higher for the CE group . The 
results of 8th and 9th grade tests showed that achievement in basic 
skills of math and reading were being clearly but not spectacularly 
impacted by the CE program. In math, the junior high schools not only 
surpassed average results in the county but were higher than State 
averages i reading outcomes were higher than county but lower than State 
averages. The conclusion stated that related achievement in the basic 
skills will likely surpass State and national norms for many schools, 

The Prince George's County, Maryland, project is particularly interesting, 
for we were able to secure t\?p separate reports of the study, Since they 
dealt with the same data but used different sources to disseminate the 
findings, we have presented both reports (Crawford and Bowen/M,F, Smith), 
While the descriptions varied in detail, both reports used the same 
terminology to describe the findings that when individual classes ware 
combined across schools within grade levels ta form experimental and 
control groups, the experimental samples scored significantly higher in 
reading and arithmetic with exceptions of 6th grade reading and senior 
high language usage and social studies. Both reports used the same 
terminology in concluding that the results seemed to confirm that students 
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involved in CE are different than those not involved. However , both 
reports stated that one should be cautious in attributing cause to any 
one factor. 

Since the Union County, North Carolina, study covered a period of two 
years , two reports are cited. In the first year, the researchers 
(Cox and Parramore) reported that 6th grade achievement among the treat- 
ment students was greater than the control sample in reading (.05); 
there was a difference but not a significant one in arithmetic achievement. 
The 7th grade section of the report stated that mean grade equivalents 
showed the inequality of groups with the control group achievement higher. 
The evaluators stated that , in their belief, had pre-tests taken place, 
there would have been a significant difference in beginning knowledge 
of the groups— with the control higher, No further conclusions were 
presented. In the second years the researchers (Clary, Cox, Parramore) 
reported no significant gains by treatment students in reading; however , _ 
on math, most language subjects subtests, spelling, and the total bat- 
tery, students had significantly higher mean percentile scores on the post-test* 
Regarding the control, the increases were not as statistically significant 
as the results for the treatment students* Regarding comparison of 
groups: the treatment students' gains were significant on two sub-tests 
and the total battery: mechanics of language (,01) s total language (.05), 
and total test battery (.05). 

The Kentucky study in Region XII was reported on two occasions, (Omvig, 
f 74 and '76), In the 1974 report, Omvig found no significant comparisons 

37 

ERIC 



=34- 

between groups at the 4th grade level. For the 8th grade, he reported 
significant differences for the CE group in math computation (.001 level) 
and that the group learned this skill at a relatively faster rate. For 
the 11th grade % Omvig reported the finding that the CE groups was slightly 
lower on math applications and slightly higher on study skill graphics. 
Because of the relatively short time period (one year) covered by the 
study p Omvig did not anticipate many significant changes. In fact, he 
pointed out that basic skills take years to develop and/or modify. He 
concluded that* as had been expected , academic achievement levels did not 
vary to any great extent between the groups* 

The Kentucky study In Region XII reported additional data in 1976, 
Omvig noted that the previous control group d^ca from 1974 were utilized 
in the 1976 analysis. This tim« he reported* for the 4th grade, that when 
groups were compared, five signiKi^nf: differences were identified, In 
all cases the CE group had hlghrtt ? jans md were especially significant 
in vocabulary and iius'th computation. He felt that perhaps of most sig- 
nificance was the difference in the total score, a composite of eight 
subtests. In the 8th grade , two significant differences were found in 
favor of the CE group—reading comprehension and study skill/reference, 
The GE group outscored the control on all subscore i except spelling, In 
the 11 th grade, he found no significant differences between groups, 
Omvig concluded that overall the CE students tended to demonstrate 
higher achievement scores and that they especially outperformed non-CE 
students at the lower grade levels, r e suggested that the lack of 
differences at the high school level may have been attributed to the fact 



that the patter a of achievement had been wall established prior to these 
years. He also noted that the program concentrated on the lower grades 
and that it was more difficult to integrate CE into the high school since 
not all students follow the same curriculum. Therefore, the researcher 
felt that the differences in achievement at the lower grades may really 
be a reflection of the effect of different curriculum approaches* 

The Jefferson County, Kentucky, study (Rapley) reported data as part of 
the overall systemwide achievement testing program* The conclusion was 
that although the number of students tested .was in some cases not very 
large, the general trend was obvious % there were sizeable gains in most 
grades, probably larger than would be expected in the short interval 
between the testing* The report concluded with the following statement; 
!, We feel, therefore, that there is a strong probability that the CE 
program (perhaps in combination with other instructional programs in these 
schools) had an overall positive impact on both reading and mathematics 
achievement s ff 

The Cobb County, Georgia, study (Katz and Morgan) reported that the 
objective of increasing academic achievement was partially attained. 
However, this was based upon a simple comparison of mean composite 
scores which were generally more favorable to the four project schools. 
The researchers responsible for the evaluation component did not test for 
significance . 

State systems . Two States reported research on this issue: Minnesota and 
Kansas* The Minnesota study (B.B. Smith), a "summative evaluation" of 
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seven projects, utilized specially developed tests to assess CE impact 
on cognitive achievement. It was reported that the impact was minimal. 
The major findings: differences in student achievement were detected 
for experimental and control groups, but these differences were small and 
not always in favor of the experimental groups. Students in the experi- 
mental group, however, tended to have slightly higher mean scores in 
grades 1-3 and 4-6, The data suggested a trend for the experimental 
students, particularly on the 1-3 test; 67% of comparisons were in their 
favor* Four explanations were given for the overall results i (1) the 
possibility that the tests did not adequately sample the content em- 
phasized by teachers in the exemplary projects? (2) teachers in the control 
schools had perhaps been teaching CE concepts, (3) inadequate amount 
of instructional emphasis and time (1^ hours per week) ? and (4) one 
year of CE instruction may be insufficient. 

The Kansas study (Schultz) indicated that there was no significant difference 
in math or English achievement in the project. However, the treatment 
population did significantly better than the control in 7th grade social 
science and in 7th and 8th grade science. The conclusions drawn : The 
CE treatment certainly was not debilitating. The findings "were not too 
surprising when one considers the less experimental nature of (academic) 
disciplines vis-a-vis social science and science (which are more experimental 
and hands-on type of instructional) these reasons account for the 
dichotomy of scores insofar as levels of significance,.. We feel that in 
a statistical , as well as an academic sense, CE has proven to be a success, M 
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The Partners in Career Education study. The comprehensive research 
conducted by Partners in Career Education in Texas (Elvis Arterbury, 
Director) was a two-phased approach i Study #1 dealt with language artf 
and social studies! Study #2 with mathematics. 

In Study #1, statistically significant results were found in subtests 
dealing with reading-vocabulary, language-mechanics and expression, and 
study skills-reference and also on total reading scores, total language 
scores and on the total test battery * While the report noted that the 
studies were not conducted according to rigorous research designed 
criteria, the results reaffirmed the belief that 01 can make a difference, 
Student achievement was attributable to support provided and special 
efforts of the teachers. 

In Study #2, the report specified that even though pre-test scores indicated 
that the groups were not accurately matched f the pre- and post-test 
mean score differences recorded for the experimental group were higher 
and a statistically significant difference existed in one subtest I 
math application (iOl), The report concluded that the methodology for 
infusion should help allay fears regarding implementation, for the 
students progressed in every academic area tested at a rate equal to or 
greater than those not utilizing CE# 

Four recent Office of Career Education projectS"F¥ 75 » Of the four projects 
which included data from the Office of Career Education grants during the 
period 7/1/75 to 6/30/76, one report (T.C.Smith, Jr.) clearly indicated 
that a career orientation course—for bilingual adults in Texas— was found 



to enhance reading comprehension significantly in about one^half of 
the instructional time used for a significant increase via the regular 
high school diploma or equivalency approach. The indication was that the 
use of a Grid demonstration (telecomputer system) resulted in significantly 
higher cognitive achievement than when instruction was presented without 
access to the Grid, This led the researcher to conclude that integrating 
oceupationally relevant content and basic skills enhances and facilitates 
mastery of basic skills, at least for the adults who were involved in 
the program. 

The study from the Northwest Tri-County Intermediate Unit in Pennsylvania 
(Minnis) reported only minimal differences between experimental and control 
groups and concluded that given the limited amount of time during which 
the students were exposed to the projects the benefits of CI could not 
totally be assessed by the testing program* The study noted that all 
groups made gains in achievement but that it was not possible to show 
that through the use of career units greater gains were made by the 
experimental group, 

The data from Newark, New Jersey (Streit) indicated 5th grade students 
showed significant improvement in both reading and math but that the 
treatment appeared to have no overall significant impact on increasing 
reading test scores throughout the grades and only varied impact by grade 
levels in increasing math scores. (2nd, 4th, and 5th grade pupils who 
were involved in CE achieved actual post-test scores which were higher than 
the predicted post-test scores.) 



The fourth study—in Richardson, Texas (Brownlee) — concluded that the 
impact of the project in terms of producing significant cognitive gains 
among Jtudents was found to be negligible, However, the report pointed 
out that the intervention period during which student instruction was 
provided was limited to a maximum of 12 weeks. 

Regional R and D laboratories . Four R and D laboratories over the past 
few years have conducted extensive research on various experience-based 
(EBGE) programs. 

The Far West Laboratory for Research and Development study (Christensen 
and others) looked at several skills areas. In written communication, 
students showed a very significant Increase in their knowledge of the 
mechanics, ability to communicate effectively/ and maturity of written 
thoughts* While they improved their writing skills, the report indicated 
that there was no reason to assume the FWS (program) is either more or 
less effective than comparison schools in this regard. Similarly FWS 
students improved their reading skills but not significantly more or less 
than comparison students; the experience did not result in any disadvantag 
relative to students in more conventional high schools. In terms of 
quantitative skills * FWS student effects did not significantly differ 
from those obtained by comparison students* Overall, the experimental 
group had a greater average change in math, although the difference was 
not significant. In reading* the control group changed more than did the 
experimental group. The researchers concluded that the learning of basic 
skills did not suffer through the elimination of classroom instruction: 
there was no significant difference in performance between the groups s 



despite the fact that the remedial portion of the basic skills program 
was not fully in place until the spring of 1974, /Note ! data on basic 
academic skills was not reported by the FWL for 1975*7 

Research for Better Schools (RBS) in Philadelphia has conducted several 
research studies in this area, The report of April, 1975 (Kershner and 
Blair) indicated that only minimal support can be given to the hypothesis 
that experimental students were superior, to control students. The 
experimental means were always higher than the control means but only in 
the case of one subtest was the difference statistically significant 
(arithmetic applications); the experimental group did not show any signi- 
f leant gains over the control group in the other basic skills subtests. 
The researchers concluded that the experimental students gained significantly 
in basic -skills during the project; basic skill gains of experimental 
students were higher but not significantly different* 

Later that year, RBS published additional research in this area (RBS 
report of 9/26/75) . It was reported that both 1st and 2nd year experimental 
students showed some significant growth over the year but not in all areas 
tested; the analyses did not indicate significant superiority of the 
experimental students in any test employed. Within group data, however, 
showed a significant growth on two or three subtests (arithmetic concepts 
and applications). In terms of comparison of groups, analyses of data 
identified a significant grade difference in reading comprehension on 
both the pre and posttest. Only one other statistically significant 
finding was identified, i.e. , a significant grade difference in pretest 
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parfermance on the arithmetic concept pretest. The experimental groups 
did not outperform their control counterparts. 

A great deal of data was generated in the RBS report on cumulative effects, 
1974-76 (Blester). The highlights are as follows; There was strong 
support for the hypothesis that experimental students would acquire 
increased mastery In basic academic skills. In terms of comparison of 
groups, the experimental group exhibited significantly higher growth rates 
when compared with performance projected from the control group on two 
out of three subtests in arithmetic. There was no significant difference 
between groups in reading, although the experimental group seemed to 
close an initial gap in performance means. Thus, there was support that 
the experimental students will acquire significantly greater mastery in 
basic skills than control students in a traditional program. The report 
ended with this note! "In conclusion, it has been demonstrated that 
students benefit from both one or two years of participation in RBS 
Career Education. . ." 

The Appalachia Educational Laboratory study in 1974 (Hllderbrand , 
Hollenberg, and Sanders) also generated a great deal of data. Using the 
Educational Development Series (EDS) as the testing instrument, the report 
indicated significant differences between groups in reading (.05) and 
math (.05); significant growth of all groups combined was found in 
reading (.01) and English (.01), Analysis of the mean gain scores for each 
of the six subtests by group indicated no overall group differences. However, 
the report indicated differences between groups on English (.01) with 
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GOOP (a control group) showing greatest gain. On the Iowa Test of 
Educational Development (ITED) t experimental students indicated significant 
growth in reading comprehension, language arts, math and science. The 
11th grade EBCI students demonstrated greatest overall growth. The report 
concluded that the EBCE program was judged very successful since it did 
successfully serve as an alternative educational program. 

The Appalachia Educational Laboratory study in 1975 (Shively) also 
was a comprehensive project. In terms of comparisons on academic achieve- 
ment, the report stated that there was no significant differences in 
achievement between the true experimental group and true control. 
Several hypotheses were considered i (1) That E^ group will acquire 
Increased mastery in basic academic skills; they apparently did not, 
(2) That E^ would do as well in basic academic skills as they did, 
but it appeared that there was little difference in the performance of 
these groups on three sub tests—reading comprehension, arithmetic 
concepts, arithmetic application, (3) That Ki (Charleston HS) will acquire 
increased mastery in basic academic skills; they showed no significant 
gains as measured by the three subtests. The conclusion was the same as 
the previous year's report. 

In the third report of the Appalachia Educational Laboratory (Shively 
and Kessel) , it was stated that the EBCE students showed no significant 
gains or losses on the same three subtests but maintained their mastery 
in basic academic skills, A great deal of data was generated across the 
various sites. The conclusion was that although the results were not 
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similar across all sites, the evidence does favor EBCE and, consequently * 
implementation of EBCE as a viable alternative to the traditional secondary 
programs has been demonstrated. 

The Northwest Regional Educational Laboratory 1975 study (Owens, Haenn 
and Fehrenbaeher) disclosed that (CE>2 students made statistically 
significant gains, especially in reading comprehension, They also made 
marginally significant gains in arithmetic concepts and application, but 
when, conditioned for reading comprehension, these gains disappeared* It 
also reported no significant differences in the adjusted mean postteat 
scores* It found support for the hypothesis that (CE) 2 students would not 
gain lass than comparable students* The conclusion was thisi Results 
tended to support the hypothesis that (CE) 2 students would make gains 
in basic skills and that controls would not gain more. It stated that this 
is an encouraging if not Impressive result, especially considering the 
fact that (CE)2 was not a concentrated basic skills program* 

The Northwest Regional Educational Laboratory 1976 study (Owens and Haenn) 
detailed these findings: For the (CE) 2 students in the program for two 
years i there was two years growth in reading comprehension during the 
first year and an additional year of growth during the second ye^r. 
Marginal growth was detected on arithmetic subtests e For the first and 
second year students: an average of one month's growth in reading compre- 
hension per month of program and marginal growth on arithmetic subtests. 

The findings for the pilot sites: while student growth * - generally 
positive, gains in reading comprehension were statistical, Ignificant for 
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only one site. Educationally significant gains in reading comprehension 



were evident for three or four pilot sites , on arithmetic concepts for 
one site and arithmetic applications for two sites. 



ItejtfLS These four programs have been supported by Mil grants. 
Ronald Bueknam , senior associate of the Mil Education and Work 
Group, holds primary responsibility for overseeing their develop- 
ment and evaluation* Utilizing data from the draft of an Education 
Testing Service final report (of January 1976) , Bueknam has 
summarized in much detail the Impact of EBCE » (The final version of 
the final ETS report is expected at the Nil in the late spring, 1977*) 
Because of the importance of his suraaary article , selected portions are 
reproduced below (The thesis is that IBCE is not designed to improve 
academic achievement but to achieve an entire set of outcomes, especially 
those designed to ease the education/work transition.) 

• There are three areas in which EBCE has sought to measure outcomes* 
Each is equally important because without positive findings in 
each,,* an innovative program cannot long exist *.,. (The three 

are: community support, academic quality, and prograraaatic 
effects*) 

• academic quality, That is. students in the experimental program 
cannot be hurt academically, especially In terms of reading and 

math achievement, by being Involved in the programs. If this academic 
consistency cannot be shown, then either (1) the programs will not 
be utilized, irrespective of the quality in other areas, or (2) 
they will only be used with students for,, whom academics are relatively 
unimportant. Both alternatives should be avoided since they 
adversely limit the usefulness of the programs 1 educational value. 

© Academic achievement is important to include in a discussion of the 
outcomes of EBCE because one might have cause to question whether 
students who spend up to 80% of their time out of a school building 
will not suffer academically, 

All four programs measured all their experiental and control 
students who started and finished using the CTBS at the beginning 
and at the end of the 1974-75 school year. The hypothesis was that 
there would be no significant difference on three subtests of the CTBS . 

The findings were as follows: Of the possible 12 comparisons, 10 
were not significantly different and two were significantly different 
In favor of the control groups. 

The evidence shows that the hypothesis (that the students would not 
be academically hurt by being in the program) Is substantially 
upheld (Emphasis added), The two exceptions are neither in the 
same subtest nor the same lab program* as shown below: 
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CTBS subtest Lab A Lab B Lab C Lab D 

Reading Comp. NS -SIG NS NS 

Arith. Concepts NS NS NS NS 

Arlth. Application NS NS NS -SIG 
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III, THE CONCLUSIONS 



Three general observations. 

(1) It would not be accurate to say that all of the projects were full- 
fledged experimental designs or that the evidence leaned overwhelmingly 
toward the experimental groups. The researchers themselves pointed out 
a number of delimitations in their studies and the Data Charts disclose 
that the experimental groups did not consistently outperform their 
counterparts. Yet, the overall data is reassuring . Looking not at 
one isolated report^ but viewing the total picture, bne can observe 
the situation as quite favorable. There are some who have felt that 
CE would hurt academic achievement . That is certainly not an inter- 
pretation this analyst would draw from the data. In my opinion $ the 




data should be enough to whet the appetite of CE supporters and critics 
alike. It is sufficient, I believes to enable even the latter to say* 
"Yes, perhaps there i£ something to this approach to education...*" 

(2) Of the 38 studies, the findings were generally supportive of CE 
in certain areas: 19 studies reported data which Indicated that either 
reading and/or mathematics was impacted at either an .05, .01, or .001 
level of significance or, in the case of the R and D laboratories 1 studies, 
which indicated that the treatment students maintained their growth in the 
basic academic skills areas. Sixteen studies were moderately supportive 
in that they reported data which either indicated reading and/or math 
grade equivalent score improvement, achievement gains for both ex- 
perimental and control groups, or varied impact, i.e.. CE neither 
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enhanced nor inhibited growth in these areas* Three studies reported 
data which indicated either negligible or minimal impact, The overall 
observation I would make is that academic achievement generally was 
either impacted positively or, when it was not, It did not interfere 
with that goal. In a word (two actually) , I believe that the studies 
can be interpreted with guarded optimism , CE surely has nothing to be 
"ashamed of" when it comes to basic academic achievement, 

(3) In some ways it is difficult to summarise or be "analytical" with 
the data since they are so comprehensive and since the studies varied 
so greatly, That is why this analysis is basically presented in 
descriptive terms. Nevertheless, I believe the general directions are 
positive and the overall tendencies are clear. . .to this analyst, at least 
However, as I Indicated earlier* each reader is free to draw his or her 
own conclusions, Those presented are mine, 

***** 

On the chart which follows, I have attempted to suranarize the studies 
on the basis of these general tendencies $ as I observed them. Originally 
it was my intention to submit the data to a panel of judges to try to 
determine how they would categorize the studies. Unfortunately, the 
pressures of publication time intervened and this was not done, It 

occurred to me, however, that each reader would be free to do this 

and so our "panel" has become much larger. 

This is how I see "the complete picture": 
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St .dies vhich were generally supportive in certain areas,,,,, 
Olson (.01 In matft*' .01 in language grades 1-6) 

fCrawford and Beven (.001 in reading & math in 7th & 9th grades) (Note: 

hf» F, Smith (*01 in reading and arithemtie) discrepancy) 

Green and Hild&brandt (.01 in reading in 2nd grade, ,05 in math) 

Bryant (.001 in •»tal battery, ,01 in reading, ,001 in vocabulary, 
,001 in language, ,001 in mechanics, ,001 in expression— 
in 5 tlx ,p v;ide) 

Partners in CE (,01 in readings ,001 in language, ,001 in expression; 
,01 in math application-in 5th grade) 

Omvig f 74 (.0v'; In math computation in 8th grade) 

Omvig f 76 (.Cv In vocabulary and math computation in 4th grade; 
.01 in jtiiad^ng comprehension in 8th grade) 

Cox and Parramore (,.0:* in reading in 6th grade) 

Clary, Cox and Parramore (.01 in mechanics of language, ,05 in language 

total, ,05 in total test battery-in 3rd grade) 

Gibboney Associates (reading: .001 pretest covariate; math ,01 pretest 

covariate) 

Studies of the R & D laboratories: 

AEL: Hilderbrand, Hellenberg, Sanders (,05 on H)S test; ,01 readings 

,01 English) 

Shively ( E group did as well as C group in basic academic skills) 
Shively & Kessel (EBGE students maintained mastery in basic academic 
skills) 

NWL: Owens* Haenn, Fehrenbacher (statistically significant gains, esp. 

in reading comprehension) 
Owens and Haenn (significant gains in reading comprehension in 3 

of 4 sites) 4 
RBS* Kershner and Blair (E student gained in basic skills during project) 
RBS - 9/26/75 (significant grade difference in reading comprehension) 
Biester (cumulative effects - support that E students will acquire 
greater mastery) 

FWL: Christensen et al (experience did not result in any disadvantage) 
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Studies which were moderately supportive . , , , , 

Gibson (no tremendous boost - . - but no loss either) 

Minnis (ail groups made gains . , * but not possible to show effect 
of treatment) 

Rapley (sizeable gains in most grades * . • grade equivalent scores) 

Morrison (growth gains * • - grade equivalent scores) 

Laplnski (gains . . . grade equivalent scores) 

Wasdyke (statistically significant gains within group) 

Bagley (,025 in reading* but not in math) 

Strait (varied impact in math, but net in reading) 

T. C. Smith (adults * , e enhanced reading comprehension in 1/2 time) 

Gagliardi (gains * . . grade equivalent scores) 

Katz and Morgan (overall means were equal or higher) 

Huffman (substantial growth in all areas . # , program neither enhanced 
nor inhibited traditional learning process) 

Schultz (treatment certainly was not debilitating) 

Simpson (approach does not interfere with learning) 

Dade County (reading skills somewhat higher; math and reading ^ clearly 
but not spectacularly impacted) 

Conway (both groups showed achievement gains) 

Studies which were unsupporfcive 

Felt (non^significance) 
Brownlee (impact negligible) 
B« B* Smith (impact minimal) 
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* * * * * 



Grade level observations . 

Few generalizations can be drawn, I believe, from the data with regard to 
the question of grade level signif icanee. It Is interesting to note, 
however, that in two out of the three studies which were categorized as 
unsupportive, the data was collected and interpreted in broad terms, i*e», 
in situations varying from K-12 and 1-9, The overall picture looked like 
this: 



Grade level which significant 
data was found in generally 
supportive studies 

Olson - 1-6 

Crawford . . . - 7 and 9. 

Green * * . - 2 

Brymnt - 5 

Partners * * * - 5 

Oravig f 74 - 8 

Onsvig '76-4 and 8 

Cox * • • - 6 

Clary . . . - 3 

Gibboney * s * - 10-12 

R and D labs - high schools, 
mainly 10-12 



. . .moderately 

.supportlyjL studies 



Gibson - 6 and 8 



tunsupportive 
studies 



Felt - 4 and 5 



Minnis - K, 2, 4, 9, 10 Brewnlee - varied K-12 



Rapley - varied 2-11 

Morrison - 8 and 9 

Lapinski - 9 and 10 

Wasdyke -3 

Bagley -6 

Streit - 2, 4, 5 

T. C, Smith - adults 

Gagliardi - 8 

Katz -..--3,4,6 

Huffman - 3, 6, 8, 9 
SchultE - 7 and 8 
Simpson "3, 4* 5 
Dade City - 8 and 9 

Conway - varied 1-12 



B. B # Smith - varied 1-9 
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Subject matter observation 

Similarly* few generalizations can be drawn with regard to the question 
of subject matter focus other than to say that in the generally supportive 
studies (excluding the R and D lab studies), a few more citations of 
positive results were itemized for reading (7) than for math (5) or 
total language (5), although additional findings were positive in such 
language aspects as mechanics and expression, In the R and D Studies, 
both reading and math components were favorably reported, particularly 
reading. 

Length of data collection observations. 

Here, too .while it is difficult to generalize, some observations can be 
made. On this point, unfortunately, a number of the reports had limited 
information so that the length of the period only could be infered. Most 
appeared to be for one academic year. Of the three unsupportive studies, 
Felt apparently researched students who had been in the CE program for 
3 years, but the actual testing period was not indicated ; Brownlee's 
instruction was limited to a 12 week period; and B. B, Smith indicated 
that a one year period - 1 1/2 hours per week — might have been insufficient , 

With a few exceptions, most of the studies in the moderately successful 
category appeared to collect data over one academic year, Gibson, however, 
reported scores over a 3 year period; Minnis cited the limited amount of 
time during which students were exposed to the project; Wasdyke indicated 
exposure to the curriculum unit over a 6 week period; the Kati and Morgan 
results were based on tests taken at the end of the 2nd year of the project; 



Huffman reported data at the and of a 2nd and 3rd year evaluations. 

In the studies which are categorized in the generally successful groups 
the variation is similar. Olson described a 3 year CE program, but it 
was not clear if the test resultswere for this entire time since an 
earlier Olson report (1972) cited some of the same data as the 1974 
study. Some of these studies compared scores from one year to another 
(Green and Hildebrandt) , The Partners in CE study indicated 17 weeks 
of student instruction in the language arts phase, Omvig's two studies 
cited data collected over one academic yea^ as did the two from Union 
Country* North Carolina (Cok and Farramore, Clary and others). Gibboney 
Associates report on the long-range program of the Opportunities 
Industrialisation Center but indicated that the average time between 
pre testing and post testing was 8 months, Most of the studies of the R and 
D laboratories were for one academic year s but one RBS study (Blester) 
reported cumulative program effects, 
CE treatment observations, 

As with the length of the data collection period* it is difficult to 
generalize since* as stated before, it was not always possible to as= 
certain — from the printed reports — the degree of the "delivery, of 
program components". (One researcher, M. F» Smith* spoke of this as 
H the nebulous variable ,, -and it was.) I wish it were possible to illustrate 
clearly and simply the direct relationship between the scope and intensity 
of the CE treatment and the results. But* because of the nature of the 
reports* a one-to-one relationship can not be easily drawn. However* 
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some general observations again can be made, 

In the reports of the three studies which were categorized as unsupportive, 
little CE data was given, Feit implied that a week of inservice training 
preceeded monthly afterschool planning and implementation of CE units | 
Brownlee described "2 data centered systems' 1 (sequencing and needs assessment) ; 
B s B, Smith implied that activities included inservice training, the use of 
different curriculum or instruction materials, and guidance services * 

On the other hand^ the report of the studies which were categorized as 
generally supportive appeared to have rather detailed activities delineated* 
For example! Olson listed a number of teaching strategies; Crawford and 
Brown/M. F, Smith—workshops and classroom guidance! Green and Hildebrandt— 
the use of GE units and course materials | Bryant — teacher developed GE 
curriculum guides; Partners in CE- — numerous staff development activities; 
Omvig"a 3 year developmental program; Gox and Parramore, Clary and others— 
inservice workshops, career centers, and numerous program activities; 
Gibboney Associates— a well-developed Urban GE Center with various programs; 
and the R and D labs — a comprehensive program of "experience -based" CE, 

While it cannot be stated unequivocally that the more intensive GE 
treatments lead to the more positive results, it can be observed that 
when the results were, indeed, "generally supportive", a fairly intensive 
CE program appeared to be in place, 

What are the effects? 

What are the "expected effects" on students in CE programs? la CE becoming 
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a "substitute" for basic curriculum? Does it interfere with the goal 
of academic achievement? As the CE concept is being discussed more 
frequently s these are some of the questions people are beginning to 
ask. Perhaps this analysis will help begin to answer these questions* 
True, the total number of studies was not large and some of them left 
something to be desired. On the other hand, these 38 studies represented 
just about all the existing research on this very specific issue. At 
this point in time* they are just about all we have to go by* There= 
fore, f at this point in time 1 , one can note that, with few exceptions, 

there were few adverse effects, CE does not appear to ring the death 

kneel for the teaching—and learn ing —of the basic academic skills ^ 

I reemphasize this point by having some of the researchers speak, 

briefly, for themselves.* 

Gibson! "... there was no loss either 11 
Minnis : " , . .all groups made gains in achievement" 
Rap ley: 11 , ,, sizeable gains in most grades 11 
Morrison t ". . . growth gains . , 

Lapinski* "a check of 5 students, , , maintained and improved their 

grade level scores 11 
Wasdyke: "analysis of difference within groups,,, significant" 
Bagley: ",,, appears to have affected students' growth in reading 

achievement during the year" 
T, C, Smith: "...enhances and facilitates mastery of basic skills" 
Streit . .significant improvement in reading and math (G5) ,f 
Gagliardi: (",,, modest but steady gains,,,") noted in a letter 

from a city administrator) 
Katz and Morgan! ",,. overall means for project schools were equal 
or higher" 

Huffman* "... continued growth in achievement, as should be expected" 
and "neither enhanced nor Inhibited the traditional 
learning process" 
Schultz: "The CE treatment certainly was not debilitating" 
Simpson: ",., approach does not interfere with academic learning,,, 
In some instances achievement may be enhanced,,," 
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Dade County! clearly but not spectacularly impacted by 
GE program" 

Conway: "both groups showed achievement gain, . , 11 

Olson: "*.,an effective method of increasing academic achievement 11 
Green and Hildebrandt t ", , .considerable evidence to substantiate,,. 

experimental students would score significantly 

higher... 11 

Bryants ", , .positive effect upon cognitive growth," 

Partners in Gil "Result reaffirm belief that GE can make a difference. 
Student achievement attributable to support provided 
and special effort of teachers," 

Omvig < f 76)i "It appeared that GE students outperform non-CE students 
at lower (grade) levels." 

As far as the R and D laboratory studies are concerned, the conclusions, 

while stated differently s were basically the same: the experience did 

not result in any disadvantage, in fact, in many cases the experimental 

students did as well or better than the controls in basic academic skills. 

Christensen and his colleagues summed it up in their conclusion: "The 

learning of basic skills did not suf fer, , , .The primary emphasis of the 

program is on skills acquisition through field experiences," 

Some additional "data" and concluding thoughts. 

In reviewing the 38 reports, as well as a similar number of background items, 

I came across several other pieces of "data" which should be shared! 

(1) The national survey on GI conducted for the academic year 1974-75^ 

documented this data: 

Approximately 20% of the nation* s teachers have been 
Involved in career education activities, Of fifteen 
student career education activities assessed, although 
half of the nation 1 s students were in school districts 
in which at least one was implemented broadly, *only a 
fifth were in, districts that had implemented over half 
ths activities broadly and only 31 were in districts 
where all had been implemented broadly . (EmphasTs added) 
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I could not help but wonder, as I conducted this analysis, whether the 
programs, I was reading about were in districts where CE was conceived as 
being "implemented broadly," I would presume that extensive research 
probably has not yet been conducted in most places where comprehensive 
GE implementation is evident, 

(2) In handwritten notes (dated 7/29/75) which I came across, Loie-ellin 
Datta of the NIE Education and Work Group presented several interesting 
insights! 

The 4, 5, 6th grade reading slump and 10th grade 
dropout are pretty well known problems. Including 
data on academic achievement due to increased 
motivation may be a very sensitive measure for 
grades 4-6, insensitive for 1-3, and inappropriate 
for 7-12; dropout reduction may be sensitive for 
10th grade but not 1-9. 

I believe that future research in this area should be conducted on the basl 
of this, and similiar, assumptions, 

In addition, some guidelines for research were presented i 

Develop a conceptual framework for GE evaluation by 
cluster, emphasising short v, long term goals and direct 
y* indirect outcomes so evaluations can be presented in 
con text * 

Double check objectives and evidence of meeting them for 
each project ,we should know why some objectives are 
harder to reach than others, 

These two recommendations speak for themselves, 

(3) One of the reports (Omvig f 76) included a section addressed to teachers. 
He asked them several questions including this one: 
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"What was the most rewarding experience you encountered in 
working with your students and CE?" 



Seven responses were given s in this order t student enthusiasm, enjoyment, 
and interest; class activities; increased academic performance and relevance; 
increased career awareness and performance; completed student projects; 
progress of slow learners and underprivileged students; and community 
cooperation. 

Part of his discussion, because of its relevancy, is cited in full: 

The teachers felt that Career Education established a 
relevance to the classroom that had been lost, and that 
because the students can see how academic subjects will 
be utilized later in life they demonstrated a greater 
eagerness and an increased inquiry into the world of 
academia. Teacher after teacher referred to 'the increased 
interest and attendance 1 , to the fact that the students were 
now 'given reasons for going to school and for setting goals 1 . 
Their concern for school seemed to have resulted oftentimes 
in an improved performance level by the students'. One teacher 
said her most rewarding experience resulted from the students' 
'improvement in grades and their changed attitude toward work', 
and another teacher saw this year as being ' the most rewarding 
in all her years of teaching 1 , She said, 'the children were 
happy, absentees were at an all time low, and achievement at 
the end of the year was higher than all my teaching years'. 
This improvement in the students' academic performance did 
not, however, stunt or preclude their growth and development 
in the areas of self-confidence and self-concept, that are 
intrinsic to the career awareness that should result from 
a Career Education program. 



These classroom teachers — and other like them — are truly at the heart of 
the CE process, Their judgments should be earnestly regarded. 
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DATA CHARTS 



]_ NQtei The studies are arranged In the order 
as they appear on the list in Part III._/ 



Go 



ERIC 
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SUBJECT AREA 


LOCATION 


1 

RESEARCH DKIGM 


IN&lKlmENIS 


Mil OF SAMPLE 


Languagt and 
mathematics 


West Virginia 


Quaii-experifflentai d€ilgn 10 
(FritiSt*Fosttest faequj- 
vilent Control Group Design) 
described by Caipbell and 
Staniiy, 


California Language Achieve- 
ment Tests; California 
Mathematics Achievement Tests, 


2U s experimented 
205 5 control 
419 ■ total 


GRADE LEVEL 


STATISTICAL ANALYSIS 


DELIMITATIONS 


CE TREATMENT 


TYPE OF STUD! 






Groups did not hive pre* 


Emphasis on career aware 4 ' 


Funded under Part D, 






expetimental sampling equi- 


ness; Stiff development 


Vocational Education 


14 


Analysis of covarianci 


valence. Subjects not assigned 


activities for 29 teachers; 


AmendoienCs of 1968 f 




(Multiple Regreesion 
Analysis) 


to treatmeriC groups tandoaly 
from 8 com population! 
Experiiintal itudints randomly 
selected from Intact class of 
Students involved in Awateniii 
Progrii; control students 
selected from remaining students 
who hid not participated. 


teaching strategies then In- 
cluded fitld trips, resource 
role lodils* manlpulativi 
activities, slfflulatiafli mlti= 
mtdia activities in resource 
units, Students provided with 
planned CE experience! for 
2 semesters (overall 0E 
program was 3 years) 


1A 



ERLC 



$ ^Ali I tatios significant at ,01 liveL The inilyiig of data on the 
H\ tut iMttumtflts yiiid F ratios of 7. 32 (language tiii) 
; 14*30 (ssth test) i Thi adjusted pesttest nans for experimental 
group 111 higher thin adjusted postteac means for control group 
on languga ichiiviient* Data on sathiutici achievement indkati 
the diffarinei betvaaa the esperiientil and control groups was 
significant at ,01 ItviL The adjusted postteet means for experi- 
natal group were 24, SZ higher than adjusted politest means for con- 
trol group on oath achievement, 



Eipoft of the data (as stated in the 1972 report) ; studenta who 
am provided with planned EE experiences for two gutters win 
significantly different on language and math achieveiint from thpsi 
who ware not exposed... 



ICLUSIONS 



Study provides evidence to support 
hpthiiisi Utilizing experiential 
activity to illustrate abstract symbols 
and concepts related to CE gdali (life 
goals & academic subject goals) is an 
effective method of increasing acaderaic 
achievement, In^serviei education 
which focuses on both process (human 
relations) and task (plinning, develop* 
lent i implementation) components is 
effective in delivering CE activities 
to elementary | secondary students. 
Conclusion (as stated in the 1972 
report)! Illustrating the value 
of academic skills in terma of their 
relationship to the career world pro- 
vidis in effective vehicle for 
achieving CI goals and academic subject 
goals. 



IISEAHCHI 



LiVint A, Olson 



iruDV 



A Study of Elementary gnd 
Secondary Career Education in 
Lincoln County , Department of 
Occupational and Adult Education 
College of Education, Marshall 
University, Huntington, West Vir- 
ginia 25701. January, 1974. 



(Reported nrliir in "An Evalua- 
tion of Elementary CI iaild on 
language Achievement, Mathemr 
tics AchiiVifflint and OccupitiorH 
al Awareness in Lincoln County, 
West Virginia/ Marshall 
University, Dec, 31, 1972) 
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SUBJECT ARM 


LOCATION 


RESEARCH DESIGN 


INSTRUMENTS 


SIZE OF mit 


Sliding and nathtnatics 


Prince Giorgi's County^ 
Maryland 


Data eolitetid on posttist- 
only bisig (last monEh of 
73-74 ichepl year), 


Iowa Tests of Basic Skills 
and Iowa Teats of Eduei- 
tional Devilapmint 


m cited 


GMDE LEVEL 


STATISTICAL ANALYSIS 


DELIMITATIONS 


CE TSEAUffitJT 


. _____ 
mt OF SPY 


Selected claaaes ef gridis: 
1, 3, 6, 7, 9, 11, 12 

0 


One-way analysis of 
variance and 2 aampii 
Hests 




The data when the evaluation 
was begun and cirqumitancei 
precluded pretesting.. ^ A 
pOiEtelt only disign is used 
with no rial iiiurance that 
thi exp§ri__en_aland control 
groups vert essentially 
equivaiint on key variables 
bgfore thi treatinint was 
applied, While soffit compaf i s 
son data ii priiinted, it is 
insuffident, Difference! 
found on the poitteat cannot f 
Ehififere, be truly tied Co 
the effects of CE. 


h, a voluntary partici- 
patory expiriiental prograifi, 
which attempts to integrate 
career knowlod|§, job atti- 
tudes, cpnEunity (busintse $ 
labor* industrial) parent 
voluntitra visitation pro- 
gras, etc., into the 
curricula, Algol work* 
shops, elaeiroom guidance 
and limited financial issis- 
tance, . i , thi method of 
iffipieffientailen of the 
specific program in each 
participating school was 
determined by the staff, 


Deeeribed as an Interim 
progress evaluation— 
county level s 

2A 



ERIC 



Whin individual classes wen combined across schools within 
grade levils to form eKperifflintal and control groups, the 
ixpefiBintai s plea scored significantly highir (pcOl) in 
fading and afichmttie with exceptions of 6th gradi reading 
and thi senior high language usage and social studies 



CONCLUSIONS 



ii.on every question pDitd, , »sni or 
mort of the combined total eKperi^ 
mental groups scored better than 
thiir controls, No differences in 
these groups wen found to favor the 
controls, tee results would urn to; 
confirm that itudenti involved in 
: capr education are different than 
those not involved, However i one 
should hi cautious in attributing 
ciuie to any one faetor, The method 
of saiple seltction, the lack of con- 
trol of thi experiipental variable— 
career edueation^at experimental 
sehoplSi thi lack of pretext dataware 
some of the reasons for this caution , 



RESEARCHER 



N, Edwin Crawford > Director 
and 

Lii Haven, Project Coordinator 



/Note; See also M.f. 3 



STUDY 



Does Career Education Work? 
A Gage Study In Prince 
George' § County t Maryland , 
Upper Marlboro, Maryland 20770 * 
April, 1975, 



21 



SUBJECT AM 



LOCATION 



lading and aathmtics 



GRADE LEVEL 



1, 3, 6, 7, 9, U, 12 



Prince George's County, 
Marylmd 



RESEARCH DESIGN 



STATISTICAL AIALYSIS 



Analysis of variaaet for 
om-way design eompuEir 
prograffls; also z^sampie 
+ ttst On thi 3rd & 6th 
grade soantic diffirentiais 



Teat scores fisuUs , ., 
iirlier in year mu ^ 
cempired to scores on 
tasta given liter, Al- 
though the initial scores 
win used in this study, 
the tuts wan not givan 
for that ipecific purpose. 



DELIMITATIONS 



No one school had all 
of thi CI components in 
action; no two echoola 
had identical prggrams < 
(lee also Conclusions) 



IHSIUINTS 



Metropolitan Readinesi 
Tut, lovi Tests of 
Basic Skills, Iowa Tilts 
of Educational Develop- 
sent (uied in Uth and 
12th grades) 



she of mm 



Grade 



Control 



CI T1AMNT 



Treatments varied, Each 
school had iti m f brind 1 
of Ci, including these i 

- a career resource rooifl 
and teacher 

- 10-day workshop , buainiii- 
industrial visitation for 
teachers 

- 1 career AmlopmM 
Specialist (in 1 school) 



3 reading 58 

arith. 38 

& reading 1U 

arith. " 105 

1 reading hk 

arith, 65 

9 reading 238 

arith/ 238 



llilang, 
12 usage 

IOC 
Studies 



11? 
102 



59 
56 

95 
92 

% 

II 

181 
17? 



95 
128 



TYPE OF STUDY 



Described is an 
interim evaluation 
report— eguaty tevaL 
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FINDINGS 


CONCLUSIONS 


RESEARCHER 


Hhen individual cluses wen coibined to im total expfriiinral and 
control groups, the experiiental saiple scored higheat with the 
exception of 6th grade arithmetic and senior high language uigga ind 
social studies: 

Grade leading Arich, Lang, M i s 

3 1,007 1.002 
6 N.S. g.025 
1 tool E.OOi 
9 E.001 1,001 

U ' 12 M. 1,5. 
(1 ■ favors ixperiiin£ai group) 


Results seen to confiri that student! 
involved in CE an different thin those 
not involved t However one should bt 
cautious in attributing m%: to any one 
factor. The method of sappii selection, 
the lack of control of the nebulous 
variable (CE) at eKperisentai schools, 
the lack of pretest data, and the use 
of previously untried instruaentl are 
ioie of the reasons*.. 


Hi P, Smlthp Consultant 

/Note? See also 
Crawford and Boven/ 


.... STUDY 


Interim Study of the Effects 
of Career Education injhe 
Prince George's County Public 
School System Prince 
George's County, Maryland 20770* 
Report prepared by M.F, Smith, 
Gainesville, Florida, Octo- 
ber, 1974. 

2d 



SUBJECT AM* 


WGATIOH 


RESEARCH DESlQf 
— _ — ^ 




SIZE OF SAMPLE 


teidiag tad aath 


Ceres, California 


Pn and postttatM.fof 
group! when eoiparing 1973-74 
scores to 1974=7S, 


Cooperative Primary 
Test (W), Coffiprghensivi 
TtstS of Basic Skills 
(«) 


Briikdowni wen not cited for 
ejprimtil and control 
groups, Only these figum 
win given; 

Qradig Subject liber 

1 riiding 305 

1 math 307 

2 leading 264 
i Mth 262 
4 riiding ISO 

* uth ill 

♦ laiig, 150 


GRADE LIVE 


STATISTICAL AHALMS 


DELIMITATIONS 


GETMMK 


TYPE OF STUDY 


mini? l s 2, and 4; 
also, 8* 9, 10 

78 


Chi Squire fer 1st and: 
2nd grade , 


The pervaiivi character of 
the reading and istti improve- 
Gent programs resulted in 
broad contamination of groups 
which had been planned to be 
control groups, Therefore, at 
som grade levels, control 
groups esientially dlsippeared^ 


Inservice programs to 
facilitate tht writing and 
implementation of objectives; 
including career awsriness f 
planning and orientation* 
Oil of CI uniti and course 
naterials. Infusion of 
notarial into reading and 
math instruction, 

• 


i 

Evaluation component 
ixamplary project in 
vocational education, 
Part D of F.L, 90-576, , , 

79 

3A 



ERIC 



80 



Fiiiii 


CONCLUSIONS 


RESEARCHER 


EipMlsantal paupi significantly weedecj the control in 1st grade 
reading, 2nd 4 4th gride math and reading' 

Gradi Subject Chi Square Value Significance 

1 mih% W ,20 

1 math ,54 m 

2 fiidini US ,01 
• 2 math 4,64 ,05 


Indication that thi lore inservlce 
activities teachers received, thi 
bitter students achieve CE objectives. 
In view of the results, there is 

experiiental studenti would score sig- 
nificantly higher on standardised tuts 
thin would control , 


Bill Green 
and 

Marilyn Hildebrandt 


Data also was collected on 8th to 19th gride students. While objectives 
wire not out is staced, the results favored the egperiaental groups, 
Diti It that level wis hand on locally developed tMtSi 




■ 






sum 






Ceres Unified School District 
Cafiir Education Responiive 






to Every Student, Final Report, 
September 1, 1975, Ceres 
Unified School District, 
P.O. Box 30?, Ceres, California, 
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SUBJECT ASIA 



langu&p arts 
study skills) 



North Central 1ms- 
Cm county area 



RESEARCH DESIGN 



Pretiit^Posttist, Cgncrpi 
Group Design (Campbell and 
Scaniey.No. k) 



INSTRUbfflNTS 



hinaive Testa of 
Bcislc Skills 



grade im 



STATISTICS- ANALYSIS 



5th 



82 



Om-wiy analysis of 
covariinei 



DELIMITATIONS 



SIZE OF SAMPLI 



A iml of r M students 
mm involved (no 
specific breakdown! 
given), 



CI IffiATHEHT 



Time length of implemented 
program was 17 auks, 
Tiiehirg in experiientil 
pup hid no knowledge of 
EE prior Is tte first 

orientation period but 
wire asked to begin ifflpliiin- 
tat-ion of concepts imediatel 



Tiaehirs in the expefiffigfltil 
group participated in staff 
diVilopMt and ware givsn 
tiiehir-diVilgped CE curriculum 
guidis for uii in planning 
instruction in language art* 
and social studies; consultant; 
help provided on a request 
basis* Workshops! 2 days 
(11 clock hayra) followed 
by additional 2 days. 



mi OF STUDY 



DoGtoral dissertation 
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FINDINGS 



CONCLUSIONS 



RESEARCHER 



Total battery scores! statistically significant difference between 
groups was found to exist*. .favoring the experimental group; level of 
significance exceeded ,001 level* The battery included arithmetic 
even though CI concepts were not infused into that curriculum. No 
significant differences were found between the groups on arithmetic 
test scores. 

Heading; P value that was statistically significant at .01 level , 
Experimental group showed gain, with p<,Q0i evidence in vocabulary, 
No significant difference between groups on comprehension. 

Language; Experimental group favored in statistically significant 
difference, ., ,Even though spelling scores reflected no difference, the 
_F value*., on both mechanics and expression excelled ,001 level. 

Variation between groups; 



, ,,the integration of CE concepts 
into the ongoing curriculum can have 
positive effect upon cognitive growth, 
A fact that appears to merit attention 
is that CE concepts were not introduced 
into arithmetic and no greater gain was 
made in this area by experimental group, 
indications are strong that curriculum 
planning must take place if academic 
achievement is to increase, 





F 


P 


total battery scores 


11.89 


.001 


reading 


7.99 


,01 


vocabulary 


15,34 


,001 


comprehension 


0,88 


NS 


language 


15.03 


.001 


mechanics 


17,90 


,001 


expression 


13.56 


,001 


spelling 


0.21 


NS 



Rita 5, Bryant 



STUDY 



^An Experimental Study of, the 
Effect of a_Career Education 
Program on Academic Achievement 
and Attitudes of Fifth-Giade 
Students , Unpublished Ed.D, 
dissertation, North Texas 
State University, Denton, 
Texas 76203, August, 1975, 
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SUBJECT AREA 


LOCATION 


RESEARCH DESIGN 


INSTRUMENTS 


SIZE OF SAfflPLE 


dLuyj if i idn|uup ans, 
social studiei 


teas 


pre* and posUest 


Comprehensive Tost of 
Basic Skills 


E s 226 

c - in 

(in h schools) 


Study 11 - mathtmotics 


same 


Seme 


lime 


e i na 

C ■ 154 
(in 2 schools) 


GRADE LEVEL 


STATISTICAL ANALYSIS 


DELIMITATIONS 


CI TREATMENT 


TYPE OF STUDY 


{ 

5th 


Analysis of covariance 


none cited 


11 - Staff diVilopmint- 
curriculum writing process; 
classroom learning modules* 
Teachers from participating 
4 schools in 6 staff develop- 
merit workshops; 1/ »ieb of 
student instruction. 


Research project funded by 
three programs of the 
Texas Education Agency 


88' 


pine 


Groups not accurately matched 


12 - Stiff developfflint 
activities for 6 teachers; 
6 stiff development days* 
Teachers oriented to CE and 
thi infugian process,, .films 
and connrcial materials 
used; site visit to observe 
in on-going program, 


§7 
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FINDINGS 



Study 11 

Statistically significant risults in mhmu roddlag— vocMbulary, 
ianplp-Sichanlcg and ispressiDn, and study skills- rtifarencG ; 
alio on totil riading ieoree, total language scores and on iota! 
language scores and on total CTBS battery: 

reading total * (P) .01 
language M * (?) ,01 
comprehension * (p) M 
spilling ■ (P) B 
expression * (P) ,001 
reference s (P) ,001 
study skills * (P) .01 
vocabulary = (F) ,001 
mechanics * (P) .001 
graphics ■ (p) m 

total battery - (!) ,001 



Study ll 

Even though pretest scores indicated tr.t the 'groups were net 
fflstchidj the pre s and posttist fliian score differences recorded 
for the experimental group were higher and a gtmtletieaily 
elgnlficant diffirincs existed in om subtest; 



Experimental 
Pre- 

Poit= 

Control 
Fre- 

Psst» 

Significance \ ' 
Level I 



Computation 



30.6 



26.3 
33,7 



7.4 



Application 



1.5 
10,6 



10.4 
10.9 



2,1 



Concepts 



3,0 



16, S 
18,9 



2,1 



Total 



38.9 



53,5 
63.4 



2 14,4 



9.5 



.01 



N.S. 



CONCLUSIONS 



Study fl 



Studies not conducted according to 
rigorous research designed criteria. •. 
however, primary emphasis placed on 
GF. infoiion techniques. Results re- 
affirm belief that CE can make a 
difference, Student achievement attri- 
butiibl y to support provided and sp 
efforts of teachers, 



Stiujy n 

hodology for infusion. * * should 
i. p allay fears re. Imp Itman ta t ion , 
Students progressed at rata iqual to 
or greater than those not utilizing 
CI in every academic area tested, 



RESEARCHER 



Not cited, However, the 
Director of Partnirs in 
Career Education is 
Dr ¥ Elvis ArUrbury, 



STUDY 



Career Education and Academic 
Aehievioient in the Elementary 



School . Partners in Career 
Education, 1201 North Watson 
Roid, Arlington, Texas 76011. 
July, 1976. 
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SUBJECT AREA 


LOCATION 


RESEARCH DESIGN 


INSTRWffiNTS 


size of mu 


teadinii language, sath- 
aaaiics, study skills 


Kentucky: 

Educational Region XT I 


Pretest-Posttest disign 
gQrrispqndini to Campbell 
and Stanley 1 e Nonequlvalont 
Control Croup Dogign fllO) 
(1973-1974) 


California Camprehenpive 
Tests of Basle Skills 


Approximately 1,300 
students 


GRADE LEVEL 


STATISTICAL ANALYSIS 


DELIMITATIONS 


CI TMTKENT 


TYPE OF STUDY 


4th, 8th, 11th 


Analysis of EgvariancEi, 
pretest mm vers used 
is the cDvarlatt in che 
analysis in order to 
iliiinate psssibii 
initiii group diffirmceSi 


Because of £hi short time 
period covered by the 
research .project, it wi^ not 
anticipatid that many 
significant changes would 
be evidenced by students,,, 
bisk skills take yurs to 
'divelop and/or ffiadify, 


/See diicription in 
Omvlg * g 1976 study,/ 


University based 
research project 

91 
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FINDINGS 



CONCLUSIONS 



RESEARCHER 



M 1 4th grade - Hhtn "group" was Introduced as a main effect, no 
Significant F-valueg sera observed. In fact, Host of ths Naluud 
, vera under 1.000, 

^ grate * The s» rlable, when using "group" as a pin effect, 
ividinced m F-value uf 11,281, significant at the ,001 level 
nth confutation) ■ A comparison of group means revealed 
that the higher adjusted posttest mm m earned by the CE 
group, Their mm of 8,40 was significantly higher than that of 
non-CE students (7,59), CI students learned at a relatively faster 
rati in making math coaptations, 

11th grade - No significant F-vahe risuited,,, however, a raparigon 
of the adjusted posttest aeani revealed, Si CE group slightly tar 
on math applications and slightly higher on study skill graphics, 







Malue 




P Value 


4th 


8th 


11th 


nading veeab, a 


1.033 


0.199 


0,085 




0.003 


2.975 


1.522 


ling, mechanics 5 


0.009 


0,696 


0.234 


iSEpriSslon * 


0.422 


o.oao 


1.357 


spelling *■ 


0.678 


1.272 


3,780 


math Comp, * 


1,310 


11,281* 


2.626 


concepts 5 


0.392 


0.52? 


3,044 


appl. s 


0,012 


1,395 


3.764 


total (8) » 


0.031 


1.371 


0,313 


study skills 








ref. ■ 
graphics 1 


0.916 
1.104 


0.326 
0.693 


0,012 
3.660 



As had been nxpectedj academic achieve- 
ment levels did not: vary to any great 
extent between the groups , , , .Rgeommenda- 
tidns: that student data be gathered over 
a longer period of time, 



MQ1 livtl) 
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Clayton P. Omvig ( ! ?4) 



STUDY 



Effects of a Program of Career 
Education in Kentucky's 
Education Region XIL Dip t , 
of Vocational Education, 
Collage of Education, University 
of Kentucky, lixijigtOfl f Kin= 
40506. November > 1974. 



6B 



ERIC 



SUBJECT AM 



LOCATION 



Reading 
arithmetic, 



is groups af 
intact clasiea; 
4th, 8th, Uth, 



ERIC 



Kentucky! Educational 
Region XII. (Southeastern 
counties; 8 iadependMt 
school districts of 
Jackson, Jrnklna, and 
tard) 



RESEARCH DESIGN 




Quasi-experimental design. 
Control group consisted of 
students in 1973-74 who were 
not exposed to CG; experimental 
Hroup of [hose enrolled during 
1975-76. 



Analysis of variance to 
tilt for significance 
diffirenees ktnm aamplg 
groups j interaction and 
main effects of "six" and 
"group" were analyiyd (see 
below for "gfoup" data). 



Instead of gathering pretest, and 
posttest data during the yiaf } 
only posttest data were , 
eollae£id on the 1975-76 
group, The 1974 control 
group data wen utilized In 
the current analysis, 



California Comprehensive Tcsti 
of Mi: Skills 



SIZE OP SAMPLE 



ihUdy 
HO per group per 
xradsi,,tntiil of 9 



ce treatoeht 



/Description of program 
(2/1/73 to 6/30/76) is 
tailed in Ttetoreer Educa= 
Program for Hgz a 
hy Owen CoUiniT 
Valley Edueatisnii Coopera* 
live, 325 Broadway, 
HiEifdj Kentucky 41701, 
1976./ 



STUDY 



Program emphasised during the 
1st* year career mmm in 
grades 1-12; exploration In 
grades H for the second 
ym\ work with grades HI 
in preparation activlcies 
fflaln focus of 3rd year, Five 
phases for lach year: orient 
tatlon, preparation, in- 
iirvieei liplantatlon, 
eviluafiidn. 



A report of a project 
funded through the State 
Bufiau of Vocational 

Resources 
Unit. 
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FINDINGS 



4th grade -■ Hhfifi group wag used as win effect, five significant 
differences mi Wont If iei; in all cases the CE group had highr; 
Cleans, F-valuts were especially large in vocabulary and math compim- 
tiftn, Perhaps of most significance was a significant difference on 
total score, a cwpuitltc of eight reading, language-, mflEh subtests, 

uth grade - two significant differences in favor of CE^reading 
Mprehertsion and study skill/reference. CE group yytscurd control 
on all suhscofcS except s| 



Uth grade - On the comparison of CE and non-CE groups, no significant 
F*values appeared, 



(koup effect! rvalue and Prob 
reading vucab. 



eoipiii, 
language aiechan. 
expression 
spelling 

math romputac ton 
concepts 
flppl, 

Eotal (31 
study skills 
fef. 
graphics 
(*P .05) 



4th 

D.h9 .01* 

4,11 ,04* 

0,11 ,S1 

0.02 .87 

2.95 M 

in .oo* 

Q.94 M 

2,43 ,12 

4. 10 ,04* 



,01* 



8th 

m .53 

7.85 .01 

0.02 .39 

lip ,1a 

0.0] .85 

3,40 .06 



2,00 ,15 

2.22 ,13 

3.96 ,03* 

2.M .11 



ERJC 



Uth 

in m 

O.H? ,6] 

J.W ,07 

0.53 ,53 

101 ,08 

2.0t .14 

0,75 ,62 

0,21 M 

0.78 .62 



5.50 .51 
l.M .17 



CONCLUSIONS 



Qvarall, C£ atdeuts tended to demoi^ 
stnlto higher nchievement scores, 
only in o few naees (moitly llth grade) 
did rion^uE students consistently score 
higher. The mm urn not significant 
]jr higher.... It appeared that students 
oiit-perfcnwd non-CE students at lower 
UveU. Perhaps the lack of difference 
tit Hij 5 idvdl attributed to Fact that 
pattern sf achievement had bedn well 
Eitah'UNd prior to H years. Also, 
pfogfan concentrated on lowtr grades.... 
It was j.ofo difficult to integrate CE 
In U.S. since not nil students follow 
UM curriculum.,, Therefore, differences 
in achi eyamint at lower grades may 
really be e reflection of effect of 
different curriculum approaches. 



RESEARCHER 



Clayton P. Omvig (*?6) 



The Effects of a ?x%m of 
Careef__ Educ ation in Kentucky's 
Ed ucation Riglan Kill Phage II . 
Dept. of Vocational Education. 
College of Education j University 
of Kentucky, LiKington, 
Kentucky 40506. July, 1976 , 
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SUBJECT AREA 



leading and mathematics 



CEASE LEVEL 



3rd, 6th, Mi 
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ERIC 



Union County Schools, 
North Carolina 



RESEARCH DESIGN 



During lit year it was not 
possible to u§€ pre- post test 
design. Ml wire colltetid 
in the spring only; results from 
9/74 and 3/75 wire available 
and win mid,,, basic evaluation 
(ksign, then, m based on 
treated and untreated cotapari* 
ssni. 



STATISTICAL ANALYSIS 



One-way analysis of variance; 
regression analysis of variom 
treatment variable! against 
autOTi icons* Scores 
expressed as grade 
equivalents. 



DELIMITATIONS 



INSTRUMENTS 



Calif drnia AehiiVetnenE Test; 
leading and MithiMtiei 



CE IMAM! 



none cited 



Pf pgram activities: in- 
iifvici it ill gradi levels, 
curriculum units integrating 
carnr inforaationj group 
guidinCi, iitlbliihment of a 
career library. Alio; 13 . 
workshop? conducted and Ik 
curriculum units developed, 



SIZE OF SAMPLE 



Project 

3rd s 126 
fith i 114 
7th* J5 
205 



Cpn»ol_ 

56 
156 



TYPE OF STUB! 



Third*p§rty evaluation 
repofti of ixiffipliry 
project in vocational 
iducation conductid 
under Part D, P.L. 90^576 
by North Carolina 
State Univiriity, 



OA 



FINDINGS 



CONCLUSIONS 



RESEARCHER 



6th grade achievement among students in project was grater than the 
aehiivenent among the control sample In reading. There was a difference 
but not significant between the 6th grade means in arithfflitic achievement 
in the Hafth testing, In reading, the difference between the leans 
fcr 6th gradt in reading wag significant at the M level 

mean grade equivalent 

Diff, March Diff. 



3rd read tag 
Project * 2-9 
Control * 2-9 



rath 
C 

6th reading 

C ' 

fflath 



1-1 

n 



N.S. 



H.S. 



N.S. 



3^7 



3-5 



6-2 



6*1 
5-7 



?th grade; moan grade iquiyalints show the inaquali^y of groups— wlCh 
control group tthitvtniM higher. The two groups wire not iqual on thiao 



rydlng 
P - W ~ 



[so th 



5- S 

6- 3 



P(05 



TTie evtlititors believe that hid pritest taken piece, there would have 
btin a significant dif ft fenei in thi biginning knowledge of the groups 
with Control higher * » * * 



100 



0 

ERIC 



During the second year, the 
evaluacofe intend to odd the 
dimeniion of prs-testing ts 
evaluation procodurei, 



Walter L Cox, Jr. 
and 

M. FarrMorei 



Co*directors, 3rd-psrty 
evaluation 



STUDY 



Career Based Curriculum Frojtct , 
First Year Interim Report * 
Dr, John Maori j Director. * 
7/1/74- - 6/30/75. Onion County 
School!, P,Q, m 499, 
Monroe, North Carolina 28810, 
July 15, 1975, 
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SB 



SUBJECT ARIA 


LQCATIOH 


RESEARCH DESIGN 


IB1IIHBRS 


■■ SIEE OF SAMPLE 


todingi math, 
language afts, 


Union County SchooUt 
North Carolina 


Prqtist ind postErntlng 
(fall and spring) 


California Test Battery 


56 In projiet schools 
78 in control 


GRADE LEVEL 


— ■ 

STATISTICAL MLYSIS 


™^ — 

DELIMITATIONS 


CE TREATfENT 


TYPE OF STUDY 


3rd 


Analysis of eo-variance 
m used to adjust Eht 
obiifved differences of 
the Interviiwing variables. n 


none cited 


Same overall aetivitiei as 

in privioyg year, plus 27 

insirviei yorkihops f ispiniion 

of career cantere, further 

divilopient and iiplintatign 

of Ruidanti.icEivities, lapls - 
fientatiofi of pilot prpgrams 

all high sehsolii deyelopsant 
of currieuliiffl offering! for 
nrv Union County Career Centir, 


Thifd^pafty evaluation,,, 
North Carolina State 
Univirilty 

103 
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FMDHG5 


CONCLUSIONS 


RESEARCHER 


No significant ! 


;alns by Preject students In raiding,,, however, on 


none cited 


taph Et Claryj 


m% language (with the ixeeptlen of aubtist on usage S structure), 




Miter L Cox , Jfi » 


ipeliingi and total teat batCery f student! had significantly higher 




and 


ran percentile 


scares on poit test than pretest, Control group; 




Barbira M» Perrainore 


although there were observable gains In thy mean percentile ieorii an 






reeding* the Im'tmu were not statistically significant as the 






result for Projf 


iti students, The pattern of Increases In other areag 






(except spelling 


|) wag similar to that of the Project students, Control 






students mds i; 


.|f,lfleant pins In mean percentiles on math, language 






(except usage and structure] and total battery, Changes In spilling not 






statistically tignlf leant* 






Comparisons; Pi 


■eject students' gains were significant on two mbtescs 






and total battiry when compared to control: mechanics of linguagi 






(.01)*, total language (.OS)*, total test battery (.05)*: 








F Value 






vocabulary 


,05 






coffipFghiflsion 


.84 




STUDY 


total reading 


,55 






computation 


.55 






esncipti & probl 


ins 1,36 






total math 
iecnanicst lingp 


.12 




Career Based Currieulum Project. 


6.49* 




Second tear Interim Report, 


uie 6 itrueture 


.40 




Dr. John D. Moore j Director^ 


total lang, 


t.97* 




7/1/75 - 6/30/76, Union County 


spelling 


1,26 


.'. .| 


SchOQlS. P,0t Box 499, 


total battery 


4.38* 




Honroej North Carolina 28810, 
July 15, 1976, 


.1. , 
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SUBJECT Am 



ill E its 



Philadelphia, Pa. 



GSABE LEVEL 



Itniot high school- 
10 to 12 



ERIC 



STATISTICAL ANALYSIS 



Analysis of co variance 
(data reported in 
M, Hp Technical 



RESEARCH DESIGN 



True experimental and 
contra group diiign, 
Averagi time batwtin pre- 
and poattisting m § monthi, 



DELIMITATIONS 



Mithi findings ifg based on a 

design which his been laid to 

be difficult to achieve in 

action research; a study involv* 

ing 3 separate eohof ti of 

applicants i with participants 

h non-participants ehoien at 

random froi Che applicant pool, 

(However), the design contri" 

butes to beUevability in 2 

ways; the replication of find* 

Ingi across 3 separate groups 

iuggeit that whatever ii 

happening ^ is not i 

1-group event; the true esperi- 

iint and control groups pirait 

strong inference that whativir 

is happening ii due to tha 
intirnihipj" rather thin to 

changes which would probably 
havi occurred without QIC, 



Stanford leading and 
Mathematics Aehiiviment Tests 



EE f REAM 



The urban 01 Center Intern < 
of the Qpportunitiii Induetri- 
aliiation Centers of Sirica, 
Inc., Philadelphia, Pa, 
(Die, 1973 - Feb. 1976). It 
is made up of various cor 
paninta; Career Orientation 
Program (planning, guidance); 
Coniunity Career Frogras (de- 
signed >to help parents v isp* 
of interna i in comunity 
services) and the Carter In- 
tern Program (CIMhe 
internship phaie) * 

Other aspecti! the Career 
DiVilPpfflint Plaiii intern ass* 
eiifflentj placement of in- 
ternii initfuctlon/counsilinl, 



mi OF SAMPLE 



Reading 
GIF i 88 
Controls fi 55 



GIF = 86 
Controls 2 54 



TYPE Of STUDY 



Research report prepared 
for the Opportunities 
Industrialization Cintifi 
of tallica j Inc., which 
designed and opirates 
the Cafeir Intern Prpgram; 
supported by funds from 
the HIE, 



iOA 



SUBJECT ARM 


LOCATION 


— RESEARCH DESIGN 


INSTRUMENTS 


- Sill OF SAMPLE 






— - i 






GRADE LEVEL 


STATISTICAL ANALYSIS 


DILIHITATIONS 


OE TREATMENT 


TYPE OF STUDY 






i 


(cont f d.) 

basic iubjicEi in the 
curriculum, eounailing 
seminar. 

Academics^ English* Social 
Sfudiii, Hath \ Seiiflei 
riUEc senior high ichael 
subjects and 01 content. 
(97 packets in each subject 
+ 43 leisone in nth), Hands- ■ 
an ixperiineas, iiiefcivei 
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FINDINGS 



SIGNS 



(1) Tht interns have begun iAprovements that are statistically and 
educational significant ; 

(2) h reading, interns gained five academic aonthi (7.2 ivirigi pn to 
?J post) in in average of tight months in GIF, In mathematiei, their 
gain Wil from 7.3 to 7*7* In comparison, Chi avenge scores of the control 
acudents did not change. 

(3) Eighth grade reading level is about the minimum requiftd for moat 
skilled trades yprk. Before entering CIPi about M of the applioanti 

were performing Igjjjjj this level. At post-testingi about 701 of the control 
students vif€ itili performing below this minimum* In contrast, in reading 
and mathematics, the CIP percentage below the minimi hid dropped to about 
581. 

(4) If the percent of acudents perforaing at lean than the 6th grade 
level le considered, about twice as many controls as interns wire per- 
forming it extremely low levels in mathematics it post-testing (301 
controls; 131 interns)* In reading, Wl of the controls and 271" of the 
Interns were below 6th grade levels at post-testlngi 

(5) Controls were more likely to gum thin interns. The raw scores 

do not contain a correction for pining. If the correction is appliidj 
the performance of Interna on reading and Eithematics again shows a 
reliable increase while the performance of controls decreases, a pattern 
consistent with the progressive decline in achievement reported for many 
low-income children who do not attend special programs, The correction 
for guessing has decreased control icons such more markedly for reading thin 
for mathemstlci* 

(S) The final levels achieved by both interns and controls are still fir 
below the national averages. The average grade equivalent final scores 
on reading and machiKaties for the Interna was 7*7 and 7,7, respectively; 
for the controls, Jj and S,9| respectively, Whatevir the gaini^and their 
win some substantial iiprovaents^thitt is no blinking away the fact that 
many of the Interni still have i lot of work to do before their basic skills 
reach levels offering much hope for postsicondary ay ecus in life, education 
and work. 

(cont'd.) 



.* .Attending GIF leads to improvement 
In both mathematics and reading* a five 
months 1 gain in light months 1 in read- 
ing and i four months' gain in 
mathematics compared to no pin in this 
time for controls. If the students can 
build on this start and continue to 
develop their skills, their posE-CIP 
chances will be fairly bright. For 
about 401 of the interns, however, 
further remedial work will be necessary 
even to enter vocational/technical occu- 
pation!, For about M of the interns, 
remedial work would be needed to reach 
12th grade levels nieded for regular 
work. 



H8IARCH1R 



Richard A. flibboney 
Associate*, Inc. 



STUB! 



Career Intern Program.. An 
Experiment in Career Education 
That Worked . VoL L Richard 
A, Gibboney Aiipciateij Inc. 
1777 Helton Road, Blue Bill? 
Pennsylvania 19422. (In prigs) 
April, 1977- 

/See alsoi The Career Intern 
Program ! Vol. L Preliminary 
Results of an Experiment in 
Career Education, National 
Institute of Education. 
July, 1975 J 
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(cont'd.) 



Data wis |iv§n to indicate tk 


feadii 


lg and mh idiii 


vpant of both 




group!, Anil 


yiii pf Qdviriinsi data 


was iadieated for achieve! 


mt 




scores vith i 


mm covarlad- 




» fellows; for § 


chiiViment 




for guiising 


aeorii with preEesC csvaried! 








SOURCE OF VARIATION 
















M 


if 


I 


I 




r 




ZlilD.Nl 


1 


21*283,275 


193,393 




.001 


Group 


LiQ2J.J23 


1 - 


1*023.523 


9,551 




.01 




170*054 


2 


85*027 


.793 






Oreup x Cohort 


104.153 




52,076 








Explained 


22|&3M21 




31733*237 


35.209 




MI 


Residual 




135 


107417 








Awl 




1 / 4 

142 










Rejjfesiion 




5 


176.853 


1,692 




.10 




ii £ga lift 


in 










wins 

futMt UmUu 


U52461S5 


1 


6,252,18155 






<.oi 


Crsyp 


mm 


1 


33545103 


urn 




<,ol 


CshofC 


59,61919 


2 


29.309595 


LOSO 






Gfnup x Cohort 


118.9329 


2 


59,391645 


2,092 






Explained 


6 # 7S4.ff3Z5 


h 


1425,83054 


39.655 






Uiliml 


j,?B.wa 


133 


limn 








Total 


1D.S30.151M 


239 










RHgifiiiaft 


191.325 


5 




IMl 







CONCLUSIONS 



ilSWCEl 



3..W.639 
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SUBJECT ARIA 



Rtading, language arts, 
oathenatica, (alas social 
Studies, science, h use of 
sources) 



GRADE LIVE 



EBCE-I -- 12th 
EBCE-II - L2th 
ElCE-ni - 11th 

COOP - Uth b 12th 
12th 



statistical msis 



Multivariate analysis of 
variance; iubiequmtly a 
univariate analysis of 
varianee 



LOCATION 




iNSTRUffiMTS 


SIZE OF SAMPLE 

= .; 


Kanawhi County, 


Identifieation of two 


Iowa Tut of Educational 


EBCE-I =- 45 


West VirgiTiia 


Qvirill compirison 


Daveiopmgnt (ITED) ind 


EBCE-II ■ 45 




poupi 


Educational Developmint 
Sides (EDS) 


EKMII ■ 5 
(not includid in 
analyiig) 

COOP iLudenti-appfOK 
RANDOM atudinti ^ 120 



ELMTATIONB 



nsni cited 



CE 



EEC! ptogrin in ixistence for 
I years: 1st year davelopid 
and expanded the concept 
and developed innovative 
curriculum; 2nd year re= 
vised Instruetienal Delivery 
System, 



mi Of stow 



Research sponsored by 
the National Institute 
of Education 



lift 



FINDINGS 



R§» hypothisis tbt EBCE studintg will do si wall as comparison group! 
in ichaiagtic growth (nqtei compirlion grpype were npt liven for ITID), 

EDS; An F, value of 1,87 via found to be significant at ^,05. ..sig- 
nifkant dlffefencii bitwiin 3 groups (EBCH, COOP, RANDOM) on 
reading (F*3.62", Valui ,05), math (KQ1, Value ,05) 

An F .valui of 4*08 was found tp ba significant at ^.001« • .significant 
growth of all groupi combinid was in reading (1=15,00, ,01) and English 
(F-12.55, .01), 

Analysis of the mm pin scores for each of the 6 subtests by pup 
ifidieaEid no overall group dlfferencis; however, M indicated differincei 
bitween groups on English (N.63, ,01) with COOP itudinti ihpwini 
patest gains. 

ITEB; Analysis,* .overall EBCE students indicatid signifieinf growth in 
riding eeiprthension, lang. arts, math, and acjonce, 11th grade EBCE 
students (N 3 5) dgsenstratid greatest overall growth. 





_F 


Value 


reading * 


10,65 


IT 


lang. lEEs * 


4.20 


,05 


oath ■ 


5.17 


.05 


sc lines = 


3.33 


.10 



Alio eaae hiscoriii wire conducted: k of 9 itudinti impfsyid iub= 
staniially academically during EBCE; 5 others received "mixed ratings 11 
froffl coordinators, parents, and ttaaalves, s 



CONCLUSIONS 



EBCE program was judged very 

succifisful sinci it did auccesifully 

serve as in altefnativi educational 
program.. i i 



RESEARCHER 



J, A* Hildirbifand) 
Chirlette Holianbir^ 
and 

J, H. Sindirs 



SOT 



Final Evaluation Report . 
Experience-Based Carnr Education 
Appiliehia Educitionai kkratory, 
Inc. f ,0. Box 1348, Charliiton, 
West Virginia 25325. 
September 30, 1974, 
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SUBJECT AHA 



Raiding and mchaacics 



OEABE IML 



EICl: 
Ej * llth h 12th 
E2 - 12th 
K, - llth & 12th 



Control: 
Cj - traditional H»S 
C| = (unspecified) 



LOCATION 



Kanawha County, 
Mist Virginia 



STATISTICAL ANALYSIS 



Univiriiti anilyiis of 
vitiance; Nests; 
inilysis of varimei 



RESEARCH DESIGN 



IilfflHTS 



Frgtgit^ppsttegt 



Eg, Cj^ wtri not 
sileeted end thlfefore were 
igguKd to bi non-equivalint 
£5 the other groups. 



Comprehensive Teitg 
of Bails Skills 



CE TREATMENT 



EBCE prog™ in txiltinQi 
for ovir 3 years; 3rd yiir 
m ipmt in rifinenient 
of lubiyitenis and mitirials, 
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FINDINGS 



CONCLUSIONS 



RESEARCH! 



Conparlson of acadimic achievement: - no significant differences in 
aeadeiic achievement between true experimental group and true control, 
No othif CQopirisons were mk. 



reading MDpriheniion 
arith, concepts 
arith. applications 

F* ,90 (1,9) -■ 2.78 



F* 

0778 
1.09 
0.56 



P 

042 
0,30 
0.54 



Hypothesis; that Ej will acquire increased lastery (F<,10) in basic 
academic skills. l[ group did not shsw increased isstery; 

reading coup... arith. concepts & applications 
t-test -W.40 ■* - ti.li ' +0,92 
r 0.72 0.81 0,82 

(t.90(50)-l,30 

Hypatheiiij that Ej would dp as well in basic academic skills is C^, 
Ej did as well as ^< If appears that there was little difference " 
In the perfonance of these pups on the J subtests: 



Pretest scores 
I I 

reading coup. s 0. 78 0,62 1 
arith, concepts * 1.99 0.30 
arith. applie. « 0,56 0,54 
F.90 (l,79)-2.78 



Postteet scores 
F P 
0,65 0T59 
0.35 ,0,54 
1,11 W 
F.90 (U6H.78 



Hypothesis: that Kj will sequin Increased nsitiry In basic academic, 
skills, Rj (Charleston HS) students showed no significant (p<(. 10} 
pins as measured by 3 subtests. 



t-test 

r 



reading coup, 
-1,42 



(t,90 (15) - +1.34 



arith, concepts h applications 



D.45 
.65 



+0.J? 
.63 
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USE program wee very aueeiiifyl 
linot It did iuceiiifully serve 
ii an alternative C! prograffl, 



Joe E. Shivily 



HM'! 



STUDY 



FY { ?3 Internal Evaluation 
Report , Expgritnce-Based 
Carter Edycatio&i 



Laboratory, Charlgstonp 

Heat Virginia. August 31, 1975* 
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SUBJECT ARIA 



Reading and Datheaitics 



GRADE LEVEL 



11th and 12th 
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LOCATION 



Demonstration aite--at AEL, 
Vest Virginia 

Impietnent a t lon-= 
Bremen | Oior§is; 
Crowi^i Louiiiana; 
Ameij lowi; 

Staten Island, Ithaca, 

itid North Syricusi, New York, 



STATISTICAL ANALYSIS 



Analysis of variance 
(ANOVA proeidures) 



RISEARCH DESIGN 



Pfetest-postteat 



DELIMITATIONS 



none cited 



INSTRUMENTS 



Cofflprihensivi Tuts of 
Basic Skills 



CE TREATMENT 



EBCE program in ixiitinee 
for over 4 yiars; 4Eh year 
iinpi«iifaEion of program, 



SIZE OF SAMPLE 



AEL = 19 



TYPE OF STOP! 



Continuity o£ 
project on EBCE 
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CONCLUSIONS 



RESEARCHER 



AEL/EBCE students showed no significant gaini or losses on 3 subtests; 
maintained their mastery in basic icadanic skills, 

reading Esmp. (HQ arith. concepts (AC) arith. applic, (AA) 
F 0,081 " LOW " .006 

P >,25 >.2S >J5 

A great deal of data was generated across the various sites, In 
SuMafy; 



Sites (A to F unidentified) 



AEL 



■RC 



■AC 



-AA 



NS 



m 
m 



m 

iQ+ 

NS 

05** 

NS 



10+ 

NS 

i 

NS 
NS 



05** 



Q5** 



05+ 



NS 



i;s 



I F 


NS 


NS 


Q5» 


NS 


10* 


NS 


01* 


NS 


05 


10 



NS 
10* 
NS 
05 



NS 
NS 
NS 



a 1 Experimental pre to past difference (gain +, loss •) 
b * Comparison pre to post difference (gain +, loss -) 
c • E vs C on pretests (* E>C, ** OE) 
d = l vs C on pssccesta (* !>Cj ** c >1) 
a * I vs C en changa (absolutes) 
NS * no significant difference 

Hank spaces indicate data not available under design utilized; 
statistical analysis not conducted. 



12* 
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05- 

10+ 

NS 

NS 

01 



...although the results wire not similar 
across all sites, the evidence does 
favor I1CE, Consequently, impieminti' 
tion of EBCE as a viable alternative 
to the traditional secondary program 
has bun demonstrated, 



Joe I. Shivily 
and 

PhylL'i'3 Kessel 



STUDY 


Final Outcsffii Evilua 


Eioa Riport 


DaBonitration and b| 




tion Urn* toerlei 




Cifiar Idueition, A 


]pilachii 


Educational Ubfifitoi 




Chirliston, West Virginia* 


September 30, 1976* 
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SUBJECT AM 



Ending, ythipticij snd 
written and oral cocnuunici- 
tlon 



GRADE LIVE 



11th and 12th 



ERLC 



LOCATION 



Tlgardi Oregon 



STATISTICAL WIS 



Scep^down mulclvariite 
analysii s£ varlinci 
ind eovifiince 



RESEARCH DESIGN 



Preust-posttest; 
experiwencel ind 
control groups 



Although the cost of using a 
control group wai high and the 
number for whom data wire ob- 
tained ves shall, the evilui- 
tore feel [hit the benefit 
gained fras experimental design 
qutweighid the osite* 



Coinprehensive Test 
of Mk Skills 



CE 



EKE: A OTpreheniive* 
individualized progfai 
Integrating high school 
stuqents 1 learning of 
Buic Skills, Life Skills, * 
Career Development tough 
work & toning experiences 
in the cMirainityi "Coiiunity 
Espefteei for Career Id" 
(CE) 2 I "hands-em" ipprsach to 
learning; curricului fully 
integrated; stress on adult 
aetivltiiit fully individualize 
Students spent ibout h time 
at learning center; reiaining 
Eiffli at iipkyer & community 
litis, (Fall of 1974 to 
Spring d 1975) 



SIZE OF « 



True experimental 
group 51 

True cantrdl 
group * only 12 
available for 
posttestinj 



TYPE OF STOW 



Research iponsofid 
by the National 
Institute of Education 



12: 
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FINDINGS 



(CE) 2 icudetits aade statistically significant gains, (specially in reading 
Comprehension; thsy also siade raarginally significant gains (,05<p<,IG) 
in arithmetic concepts and application, but when condiEiorad for reading 
cDapfihension ( these gains disappear. Convifiion of expanded standard' 
icons to grade equivalent scores indicates that during approximate 6-month 
.period, (CE)2 students pined 18 souths in reading consp,, 6 in arith, 
concepts and J in arith, applications. Alio re. variability of change 
ICUIS,,. I considerable r.taber Bade negative changes... probably sore 
Indicative of test taking attitude than actual change in ability, 

No significant differences in the adjusted man pesttest scores; supports 
hypothesis that (CE), students would not gain leas than sparable students. 



_ :e: Earlier NWL studies report in 1972-73 no statistically sipifi- 
cant changes on CTBS; in 1973-74 students made statistieilly significant 
pins in all areas of CTBS except language lichanies, Bryant 3 also reported 
this 1974 data: CE students scored i mean grade equivalent gain of .7 
yiarsijhis compares to a decrease of ,1 grade equivalent by comparison 
-group./ 



iCLUSIONS 



Results tend to support hypothesis 
that (CE), students would make gains 
in Basic Skills and that control would 
not gain more. This is an encouraging 
if not impressive result, especially 
ccnsidcring the fact that (CE), is not 
a concentrated Basic Skills program. 



RESEARCHER 



Thomas Owens, 
Joseph Hainn, 
and 

Harry Fehrinbichir 



fapjrtoeja jid^areer Education . 
Final Evaluation Report. FY 1175", 
Northwest Regional Educational 
Laboratory, 710 Stf Second 
Avenue, Portland, .Oregon 97204. 
Sipttaber, 1975, 
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29 



SUBJECT AM 


LOCATION 


MIMI DESIGN 


mrnmrn 


SIZE OF SAMPLE 


Ending and each 


Tigard, Oripi plus 5 pilot 
sites; Hillitoj Oregon; 
Colvlllei Weshiniton; . 
BiiiingSi Montana; Kodlik, 
Aliika; Kinntwickj Washington 


Pretest-posttisti ixpgrifflintal 
and eontrel groups 

if 

' *•> 


Compreheniive Test of 
Basle Skills 


Tigard * 14 to 1? 
Billings * 23 
Coivilie - 20 
llilisboro » 35 
Kinniwiek ■ 30 
Kodiak » 30 


G8ADE LEVEL 


SttllSTICAL ANALYSIS 


DILIMlTATIOi 


CETMM! 


TYPE OF SIP 


11th and 12th; 

9th to 12th In Hillsboro 


(latae aa in 1975) 


none cited 


Described in previous NWREL 
study for derastration site. 

Pilot sites: 

BiHingSHiny essential cor 

ponents of model ; 
Others-high degree of fidelity 
to model , 


Research iponsored by 
the National Institute 
of Education 
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39 
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FINDINGS 



Far the [k (CE) ^ ^tudentg in progran for 2 years: 2 years gcowth in 
ttidity CMpreheuiioii during 1st year and an additional year of growth 
during 2nd year, Marginal growth detected on arithmetic subtests, Far 
the 1? Ut yiac students and U 2nd year itydinti! average of 1 month's 
gravth in reading cofflprehenslon pgr monEh of prognm and marginal growth 
on arithmetic subtests. 



In pilot sites: while student growth on CTBS was generally pesitive, 
gains in reding comprehension were statistically significant for only 
1 site, Educationally significant pins in reading comprihension (at 
least 1 Booth's growth per tooth.. •) were evident for 3" of 4 pilot sites 
and were evident on arithmetic concepts for 1 pilot site mi arithmetic 
applications of 2 pilot sites, 



13 



'2 



CONCLUSIONS 



h additional pointi cited in 
1976 ripprt f 



researcher 



and 

Jsieph F. tan 



STUDY 



Experience Baaed Career Education, 
Final Evaluation ReportT FY 1976. 
ttahwisi Regional Educational 
Laboratory, 710 58 Second 
Avenue } Portland , Oregon 97204^ 
Siptiiofeer, 1976. .„> 
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□yfiJLLl imy\ 


LOCATION 


RESEARCH DESIGN 


INSTRUMENTS 


SIZE OF SAMPLE 


i_ ■ ,„,! i I.,,, ■ ^= — .. 

Reading and Mathematics 


Philadelphia. Pennsylvania 


Pricey C-post test j the overall 
design was quasi-ixpgrlmental 
with non-equivalent control 
groups 


Comprehanilve Teste of Basic 
Skills 


H(l) 5 76 with no palopis 
comparison acudonts 

E(Z) 76 with a non-equlva- 
lent control group 

/lotii The table on CTBS 
scale scores refers to 

mm ] 




GRADE LEVEL 


STATISTICAL ANALYSIS 


DELIMITATIONS 




TYPE OF STUDY 


lQch and llch grades 
jfg control group for 12th 
grade Students m that 
eoBpiriionS at this level 
ire not prisintidi 

31 


l 

Corrolated Meets; analysis ' 
of covarianee 


The control group for the 10th 
ind 11th grades woe not equiv- 
alent in all respects but CE 
treatment to the eKperinental. 
group i :i! 


A prototype EBCE pre§rain! eiEO 
activities integrated with the 
relief the curriculti; 3 main 
instructional components! 
coreer exploration and 
spiciilizotioni guidance, basic 
skills , Students spent at 
least 1 day a wtek in a variety 
of "hands-on" activities in 
participating industries, 
busineaaeii unione; iCructured 
small group guldinci iiiiiona 
each ml\ 1 1/2 tern each 
day on individualized learning 
in communication skills and 
fflithiiitici (one yean 1973-74) 


Part of an evaluation of 
EES Career Education 
Program 
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Results Indicate .hat only minlmil support can hi given to hypothesis 
that experimental students were superior to controls, Tht axpirimenCal 
Mans vera always higher than control means, but only in the ease 0 f 1 
subtest was the differing statistically significant (arlthtatic 
applications: p ,0016); the experinental group did not show any 
significant pins aver tht control group in tin other basic skills 
subtests! reading vocabulary (p • 4613) and comprehension (p. 3658), 
artthwie computation (p . 2486) and concepts (p . 8066) 



C;BS f'x;vrir.i:nta: Group Pai n s in Scale Scores (within group) 
Posttcit Mean - Pretest Mean t Value 



EI-54 .. 

! 

iry 1,7593 
Comprehension 24,870^ 
Total " 17,4074 



Arithmetic 



12-32 

29,3974 
12,0739 
18,8684 



Total 



*P<-l0when t> :,][ with df > 



El 



91746* 
3, 72070* 



E2 

2.92737* 
1,66775* 
3.04251* 



1.4444 


29,0275 


0,22314 


3,42275* 


13.0185 


34,3000 


1,63035* 


4,18474* 


4L2771 


35.8611 


5.62534* 


4,16555* 


1U333 


34.4167 


2 . 86718* 


5.07426* 



SIGNS 



Experimental students gained significantly 
in basic skills during project; basis 
skills gains of expeiimintal scudints wen 
higher but not significantly different, 



RESEARCHER 



Keith N. Kirshmr and Hark U, Blair 



STUDY 



Supative Evaluation o f the 
Research for Better ichaoH 
Career Education Pr-cerar. 
Kesearch for Better Schools. 
1200 Market Street, Philadelphia, 
Pennsylvania 19103, April, 1975, 
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SUBJECT AHA 



Corounlcaiions and 
MthiPitlci skills 



GRADE LEVEL 



11th and lost f 
lOthp 12th 



res 9th, 
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STATISTICAL ANALYSIS 



West for paired dita 
using siatchid precise and 
posttest scores; analyses 
of viriinci on the pretest 
icprii with group membership 
ie the independent variable* 



RESEARCH DESIGN 



A true expirimintai design 
achieved through the random 
liaignffiinE of applicants to 
expef iffiintal and control grpypSi 



IONS 



Noni oiti 



INSTRUHENTS 



Comprihanalva Ttsta of 
Basic Skills 



EE TREAWEBT 



Frog™ utilizes silf'pieed 
learning resources i direct 
participation in VQcatioaal 
envirpnainti, elassrosn 
iKpiriiilcii, end idulc^youth 
intif personal interactions!, m 
focui on individualizaEign ind 

consunitHM^ ixpiriifleeii 
til Gariir 



Exploration and Specialisation, 
Gariir GuidancSj and s Basle 
Skills, 



SIZE OF SAfffLI 



El=lfi4 

E2 S 30 (nQn-randoaly selected 
rityrning group) 

Cl-66 



TYPE Of STUDY 



An examination of effects 
of EES Career Education 
PtOgtfl 
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17* 



CONCLUSIONS 



EESIAECHIR 



Both 1st and 2nd year fixperinitital students showed iMe significant 
growth ovir tile yiar, but not in ill areas tested,,,, analyses did net 
indicate significant superiority of the E students in my test eiplcyid, 
Thus, the progran was not densnsErsted tfl offer advmtagta In the 
provision of basin skills instruction, 

Within group; s significant growth Indicated on I and 3 subtests 
(arithietie concepts and applications) 

"t" for jl U 
Reading Coiprehension ! - 2, 71 

Arithmetic Concipti 2.73 
Applications 3. 33 ,~ 

(di> 30* 1,310) 

Comparison: Analysis of data identified a significant grade difference 
in reading coiprehenslan sn both pre and pogttiit, The differences 
wire consistent fron pretest to pasttest and leflect a possible grade 
linked devilspBint of reading eoisprehension, Only one other statist!- 
sally significant finding vii Identified S!i .a .significant grade difference 
in pretest pirfQmanei on the Arithmetic concept pretest. 1 groups did 
not out perfora their control counterparts, 



Rioowsendatign IS, Any suspected prsbliBi 
related to basic skills presentation shouli 
be investigated, and i plan to solve thu 
should be developed. 



BSi no single researcher cited 
(9/26/75) 



STUDY 



Career Education Program 1974^1975 
Final Evaluation Report, Sisearth" 
for Bitter Schools , 1700 Mirket 
Street, Philadelphia, Pennsylvania 
19103, September 26, 1975. 
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SUSJECT AREA , 


LOCATION 


RESEARCH DESIGN 


IBYBIKDRS 


$111 Ul 5AHrL£ 


Conunicitions and inathefflatics 
Skills 

i 


Phiiadilphii (Students from 
tht Kadesiy for C«eer 
Sducatisn, implementation 
of RBS model) 


A trite experimental design 
iQhiivid through random 
assignments of progrim 
applicant! to experimental (I) 
and control (C) groups . During 
1375-76 ! the design was main* 
tainid with students fra the 
1974-75 itudy of 1 yiir fefficts. 


Coipihinsivi Tests of iaeic 
Skills ; Reading egspntianaioni 
afittietic concipta and 
application 


"uBiuIative effects 5 
l\ ' 63 

— - — 


GRADE LEVEL 


STATISTIOAL ANALYSIS ' 


DELIMITATIONS 


CE T1AMT 


TYPE Of STUB? 


10th . 
11th 
12 th 


t-tests for paired data 
using matched pretest and 
poitttst seoriei analyses of 
variance -or aoviriinci , de* 
pending upon pretest find" 
ings; regrisiion projection 
analyses. 


None cited 


3 main instructional eomponentsi 
Career Developnient, Careir 
Guidanei and Baiie Skills* 
Exploration mtm are avail* 
able for tout 20 cluitirs 
of related careers; itydinte 
partieipati iach week for 1 1/2 
hsyri in snail group guidanci 
iiiiiona, The basis skills part 
Qgiritionaliiid as an Acadimia 
Mmm Center and fseuiti 
an csniunicatisna and math 
skills* 


An examination of the 
' effeeti of multipls yi* 
partisipation in RBS 
Career Education! 8 
itudy of gnulativi and 
second yeir effects. 

Fundid in part by 
Vocational Education 
Act in eoopiration with 
the KB. 
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Qwlativi Progrii Effects Hypothesis that 1 students would acquire in* 
creased uitiry in basic acidemic skills: 





1974 


iHi 


V 


reading eosf , 


512,33 


552,8? 


4.06* 


arithmetic! concepts 


496,98 


542.85 
530.15 


5,26* 


irithntic appiieatien - 


483,56- 


9.4R* 



us 

5,80* 



w*yfe lui l - j. j_4u men Qg £ .W.tQr J, Wjy E tilt, 

significant within group grwShall 3 eubtnts; strong luppgrt for 
hypathesii* a - H 
Caffiparison of groups ; reading coinp , 

irith. coneipts * 
afith, application! - 6,96* 
...1 pup MhM significantly higher growth rates when sosprid with 
perfonanoe projected fros C group on 2 out of 3 subteiti (in arithmetic;) 
Thirl wis no sipifieant difference between groupi in reading, although 
E group mm to etai an initial gap in perforiinee means* Thui.^iqme 
iuprt that t itudents will acguiri significantly greater matery of bask 
ikilli thin C student! in a traditional program ' 

2nd year Prog™ Bf£ectsa Hypothesis that E students would acquis tallied 
sastiry in basic academic skills: 



fei 



1975 


1976 


"t" 


508.64 


549,18 


3,01* 


520.74 
503,00 


542.79 
532.43 


2.67* 
U7* 



arithmetic concepts 

aritteitic ippligation - JfJ ,_ 
m, strong support for hypothiiii that E students would aequiii increased 
Mstiry during 2nd year, 

GOsparisgn of group i s t" 

reading coif, - 3,53* 
arieh, concepts - -0,32 
irith, applications . - BJ7* 
„,i pup exhibited significantly increased growth im on 2 out of 3 
Subtests, fa.,, partial iupport that 2nd yiar B stud a: is will acquire 
significantly greater vstoy.in basic ikilli then C students in a 
traditional progrisu 

Surory » 1974-76 (S> sipifiqanfc at JO) 

within - Group tetween - Groupi 

B S s Hi s IT 
lta * 1 s S HI NS § 
With* applk, * g a S NS i 3 



CONCLUSIONS 



In conclusion, 4 it has been diMstrated 
that students benefit tm both 1 or I 
years of partioipitipn in IS Career 
Education,,,, 



R1SIARCHER 



ThOMi N, Blester 



STUD? 



Evaluation of Cunlitiyi Effects <f 



M Career Education, 1974*76, 
Stsnreh for Better Schools." 1700 
Market Street, Fhiladelphia / 19101 
August 31, 1976. 
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SUBJECT AlEft 



Written wwjnieatlen, reading 
quantitativi ikiile 



BE IB/EL 



loth, nth, m 



LOCATION 



Oakimdi Ciiifomii 



STATISTICAL ANALYSIS 



Analysis of ooviriingi 



mmm disign 



Pri- and paittest experimental 
and control groupi 



DamtATioHi 



Result! of the reading teat 
ihaw that the poupi differ in a 
number of wayi, but thai? 
diffirinoii jja^ be largely 
attributable to the effect of 
one atypical itudent in the 
control group* 



mmti 



Iowa Tests of Educational 
Development 



CE TSIA1EHT 



FNL-EBGE prototype! a voluntary 
iltirnitivi progriffi of = cgmprir 
hiniiviniii^ individual iieT 
learning focusing on diriot 
ixpiriinoi in a variety Of 
comity settinga . . . .etudents 
pursue traditional aeadilio 
subjects and develop baiie 
ikilli through iipriential 
liarning* Activities include 
orientation, ixploratign, and 
inviltigitign* 



SIZE OF SttffU 



m (students) 

Writing * 34 

Math and reading: 
£ * 12 



TYPE OF SIDW 



Research iponiorid by 
the National Institute 
of Education {1973-74} 

yjjotCs Dita gn bade 
academic ikilli wis not 
reported by the PWL for 

my 



FINDINGS 



• ftltttn eownicitism On the basis of a writing sample judged for 
quality by independent raters, students showtd a very significant 
increase in their knowledge of the mechanics, ability to cownunicite 
effectively, and maturity of written thoughts.... stents do iinprove 
their writing skills, but then is no reason to iisune M is either 
more or leii effective than comparison schools in this regard. 

Results essentially parallel those for written eomunieation, 
TO students did improvi skills but not significantly more or less thin 
coif arisen students,,,, FWS experience dsn not result in any dia= 
advantage relative to students in rare conventional high schools, 



pntitatiyg skills: Results essentially the slug as for the other 
skills, FKS student effects not significantly different i m thou 
comparison students, 



Mem 

s.d. 

correlation 





Hath 


1 


Reading 




St 


Control 




Ml 




Control 


Nov. May 


Nov, May 


Nov 


May 


No 


v, May 


y io,i 


6.9 9,1 


10,( 


) 10.4 


1 


,8 10,2 


1.8 1.4 


1.8 2,0 


2.1 


1 2,3 


3 


,4 2.5 


.64 


.74 




,92 




.48 



fht ipriainUi group had a greater average change in math, but 
difference ii not iignifiamt, In raiding, the control group changed 
aeri than did the exparimentii group, 
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CONCLUSIONS 



The iiirning of baeie skills did not suffer 
through the elimination of elanrooP! 
instruction; thire was ne significant 
diffirineg in performance bitwien the 
groupi-thii daipiti the fact that the 
remedial portion of the basis skills progran 
vu not fully in plag§ until ipring 1974, 
The primary emphasis of the program ii on 
skills iequiiition through field experience. 



RISEARCHEI 



Paul Chriiteniin and gtheri 



STUDY 



Bjp irjeneHised Carief Education, 
Final 'Evaluation Snort FM974, 



Mm L Far Seat iatatory ~ 
for Research and pevilgpsiint, 
105$ Mm Strait, , Sin 
Francisco, California 94103, 1914, 
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SUBJECT AIM 



Unspecified 



GRADE LEVEL 



6tii graders progressing 
through program s there* 
fore, 5th to 8th 



150 



LOCATION 



RESEARCH DESIGN 



Henderson County, Kentucky 



STATISTICAL ANALYSIS 



Comparison to national 
norms 



Pretest and posttests 



IONS 



No control group was estab- 
liihid,, f ffiori concerned with 
average gain per year comparid 
with national none, 



INSTRUMESTS 



Cilifornia Comprehensive Tests 

of Basic Skills 

(total test battery scores for 

6th padii Ming through die 

3 year program) 



01 TKMHEH 



Program included: teacher made 
lesson plans and units, project 
poup work, n handion i! activi- 
ties, in-service teaching and 
workihopa j use of coifiunity 
resourcia. 



SIZE OF SAMPLE 



Cases 



1969 - m 

1971 ■ m 

1972 = 461 

1973 3 W 



TYPE OF STUDY 



Evaluation phase of exenplat; 
program - country level* 
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FINDINGS 



In all 3 yean, average scores stayed wmutet below national norm. 
YeE t during 3rd yiar there wig an appreciable gain of +14,7 points 
ivgn Ehough total batury score was itill below national wm$ (514 
comparid Ee 544, } 



CONCLUSIONS 



fall f 69 i 5,0 



local gain national gain difference 



fall '71 - 7,1 


63.5 


16.1 


-12,6 


fall '72 ■ ,' 7.7 


U,8 


20,2 


■ u 


spring '73 s 8.6 


45.6 


30,9 


+14.7 



. f .even though ye cannot say the program 
gave a Erifflendous boost to the aeadimie 
skills areas, on the other hand, then 
was no loss either. If the students... 
have realized the importance of some of 
their subjects,,. then they will be able to 
relate these to their own personal ambi- 
tion in life. It has given, at least, a 
different riaion for learning and going 
through ichool for some of the students , 



RESEARCHER 



Helvln P. Gibion, Project Director 



STUDY 



indirssn County Vocational IdSon 
Curriculum Integration Project* 
Hiifsry Report, 7/1/70 * 6/30/73 

enderssn County Public Schools, 
1805 Second Street , Henderson, ' ' 
Kentucky 42420, 1973, 
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SUBJECT AREA 


LOCATION 


RESEARCH DESIGN 


INSimTS 


SIZE OF SAfflLE 


Sliding and Mtheniaties 


Three school diitricti in 
Intertfidiate Unit 15 ? 
Pennsylvania 


Ffi-poit testing! egnprible 
control group it each gradi 
livil 


K (pgsttiit only! a MieGinitia 
Gatii Reading 

2nd and 4th Iowa fist of Basic 
Skills 

9th = Stanford Achiivisent Teit 
10th ^ STIP-3CAT Achievement Test 


i^, control 

K * IE 15 

2 ^ IE 15 

4 IE 15 

U 15 13 

10 * 13 13 
(73) 171) 


GSAJSi LEVEL 


STATISTICAL ANALYSIS 


D1LIETAIIQNI 


CE TREAMfiT 


TOE OF STUDY 


K, and, 4th, 9th, 10th 

1 

154 


t-testi enployid to datenaini 
if diffirinees between gfqupi 
weri significant; Welt 
analysis of poitteit eeDrea, 
At 4th gradi levil* an analy- 
sis of eovarianei wis utilised 
in rilation to mathematics 
aehieveinint to OTpniate for 
initial differences that 
existed in the groups 


#M liniited mmt of exposure 
time , , s , 


Uniti gn earier awirinili, 
ixplorition, and preparation,,, 
in an opin entry-exit [fiixibli] 
drier divelopmint program; e^ 
poiuri to range of eariir elm* 
tirs- sedtl eonptir rasQurai 
curriculum; in*airviei training 
(5 workihopilf individualising 
thi liirning prograi. 


Office of Career Edueatim 
Grant: 7/1/75 to 6/30/76, 

Grant »■ G007E0239B 

155 
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Minimal differences between the 2 groupi was reported, 

K poittiit mm raw scores i esg, control D.F, t value 

readineii - pan 87,87 85. 13 2S .4493 

variance 51.84 225,92 

(not significant at .OS level of confidence) 



math 




math 



9th grade 
reading 

math 



iDth gridi 
it 
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mean 

variance 
mean 

variance 



3,58 J,U 

.544 M 

3.04 3.10 

,401 .580 



21 



28 



1.2314 
,2085 



(not significant at ,05 level of confidinee) 



' mean 5,71 5.17 28 1,5913 

variance ,299 1,569 

[not significant at .01 level of confidence) 
5.S. PJ, F 
treatments ,9231 1 " ,9239 3.4060 

error 7.3454 27 ,2720 

total 8.2693 28 

(not lignifiesnt it ,05 level of confidence] 



control O.F. t value 



mean 9*35 8,17 26 ,5636 

varianci 4,43 5.75 

a. 44 8,54 26 ,0988 
variance 2M 10.83 

(not yipifioant at .05 level of confidence) 



mean 441,538 450,154 24 1J6B7 

variance 147,500 244,667 

mm mm 451,423 24 1.7172 

variance 172,517 166.083 

(not significant at .05 level of confidence) 



CONCLUSIONS 



M .in the limited mmi of time during * 
which the students were exposed to the 
project, the biftefiti of career education 
could not totally be assessed by the tilt- 
ing program, It should be enfhaiked 
that career education units did not provide 
specific proviiioni toward teaching subject 
arias in a direct fashion Mi .alao.,. all 
groupi made gains in achievement but it was 
not poiiihle to shew that through the use 
Of career unite greater gains wire nude 
by the experimental group. 



RESEARCHER 



David S. Hinds ? Project Director 



STUDY 



A Project To Deronstrate increment 
tal Improvements in a K*12 Career 
gucVtion PrggraEi Through An 
EKemplary Nodel , Northveit !ri- 
County Intermediate Unit. 252 
Waterford Street, Edinboro, 
Pennsylvania 16412, July* 1976, 
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SUBJECT M 


WCATIOH 


RESEARCH DESICH 


INS1MTS 


SIZE OF SAMPLE 


Reading and uthfMtics 


louifivilli, Kifltucky 

3 spools: 

1 fiimiiitary 

1 junior high school 

1 eenl&r high school 


pn^nd pdittyiti 


Stanford AchiiViBint Test*,, 
idiiniiterid to a laipli of 
children in each school in 
January* 1976 and all students 
Wert tested ii part of the 
eyitefflvidi achieveEent CiiCing 
progM in Hay, 1976, 


Sea tables 


GMSE UVE 


STATISTICAL MMS 


ffilffifATIQNS 


CE THEAfffiNT s 


TOE OF STUDY 


I tO 11 


Initially it m planned to 
evaluati fchi achievement 
riiulti by uilng rigriiiion 
equations to predict Hay 
icofei, biiid on the previoiii 
year*! data for the sale child 
-fin, tavern it was decid- 
ed to develop a mw testing 
props in the lerged 
Jeffenon County District^ 
id thit the old fegrisiion 
equation would no lonpr be 
Vilid, Biginnini in im-ll, 
however > it will spin be 
poiiibli to do these ngni- 
siona f since two yean of 
Stanford data will be avail- 
rile* 


None dted 


Hot |iven 


Riieareh project of 
county district 
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FINDINGS 



Pre anil posttest nana for indents who were Breasted! 
GRACE PRE-TIST 



|_ Hath 



5 

10 



1.3 

1.3 
iS 

u 
u 

5,0 
hi 

10 

i 



3.5 

3.? 
5.3 
5.8 
U 
7,3 

1 

50 
30 



Gfadsa 1-8 are In gride 
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POST-TEST 
Mini Math 


11 
tadiii 


| Hath 


Ik 

fa i *T 


i.i 




3.2 3.7 


1,3 


,2 


5.3 5,2 


1.3 


1.3 


5.7 |,5 
5.3 U 


1.6 

,7 


1.2 


U 6.9 


1.2 


.5 

1,4 



rain 

TESTED 
Reading 
33 



CONCLUSIONS 



,8 7.3 



U If 
IS 18 
31 35 



S 111 108 



26 



51 



32 


16 


31 223 




-13 


4 m 


60 


12 


30 252 
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ts; Hi ire in pyrcentili ranks, 



Though the nycta of BCudtnca tested was 
in some ciais not vtry large, the general 
trend is quite gbvioue; 

i 

There wire sizeable pine In most 
gfodiSi probably larger than would 
be ejected In the short interval 
between Chi testlngi 

We lick sufficient information, net hav- 
ing baseline data qr regfission equations, 
to conclusively attribute the reiults to 
the program, Hsvivir, the pattern of 
results ifl very consistent mm sehoola 
arid grades, Tog, the $mm infonatlon 
gathered throughput che year lives strong 
evidence that the program vie well imple- 
minted, He feel, therefore, that there 
is a Btrong probability that the CE 
pf ©gram (perhaps in qsiination with 
other inetruetional programs in thesi 
iehooli) had in overall positive impact 
On both reading and MthiBaticg achieve^ 
ME, 



RESEARCHER 



Frank L Rapley, Assistant 
Bypirintendint 
Research and Evaluation 



STUDY 



jfkhieyeiient list Results for the 
Career "Education Pregrim - 1975-76, 
Jefferson County Public Sctiools, 
m River City Hall, Louisville, 
Kentucky ml 1% 
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SUBJECT APIA 


11 


RE5EUGH DESIGH 


imwmm 


SIZE of sample 


Language and reading skills 


Indiini 


Pri-ind posE test 


Not specified 


Not spicifiid 


GRADE LEVEL 


STATISTICAL ANALYSIS 


DELIMITATIQNS 


CE TMATiNt 


TO OF STUDY 


§th and 9th 


None utilized 


Thi evaluation could not bi 
cKpected to show significant 
changes in Studsnti Since thi 
Hill tost of the program was 
to create teiehir awareness, 
The focus wis on teacher not 
studint change. Students did 
not receive i concentrated 
exposure to CE during their 
year, 

ResuIC? thi study revealed lit - 
tit difference bi twain thou who 
participated and those why did 
not in a lode! school aKperi- 


Project designed for ith and 
9th graders in an inmr city.*, 
utilised teacher made workbook 
intended to inoreaae nsding 
coiprihifision level of atudtnts 
who wife k or son years below 
gride level in baiic skills of 
phonici, word recognition and 
ceipfehtniiofl* Workboeks used 
one full period each day; 
iupplisintid by U field tripe 
during a year, 


Evaluation project part of 
the overall prograi of 
Elkhart Career Education 
Planning - local -level 
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FINDINGS 



Grovth gains in languagt and reading skills that ringtd from ,6 to 
3,3 yyra; ivirigi pin wag L5 years* 



CONCLUSIONS 



The data collictsd can be mi n a point 
of rifenncs for lataf evaiuitisns. 



RESEARCHER 



F. Hsrriioiu Program Dinstsr 



STUDY 



161 



ERIC 



Elkhart Career Center, What's In A 
Na§t? Elkhart Ares Cireir Center. 
Ilkhirt, Iniiani 46514. im. 
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SD1JECT aha 



AriEhiitic 



LOCATION 



Stanfoid, Cganeecieut 



SMI LEVEL 



STATISTICAL ANALYSIS 



IE8EUCH DESIGN 



Pre-tist - poittest 



OlLlMITATIOKi 




Only grade equivalent 
mm cited 



Bene eited 



imwm 



Science Research AnociatiSj 
Basic Skills in Atittaetic Test 



CI TOM! 



Correlated biiic education! sot 
intindid for college bound slu- 
dinMi included planned prograa ' 
of field trips* mwtm i 
ire, md vocationar guidance; 

Dceypationii laboratory -eius 
tire to familiarize atudents with 
large variety of opportunitiis, 
praste proper mage of tools 
normally found in cheat Qcaupa- 
tionij encourage skill develop- 
K&t, Gimtere varii cemunity 
Sifvle0i l QOnitruEtionjilectro- 
mechinical, bminess sacliines; 



SIZE OP Mil 



64 alow learners and 
disadvantaged youth 



TYPE OF STUD! 



A descriptive study of a 
mm asieiiiint pregri 
local level 
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RESEARCHER 


awaiQEs shun in tVijap pin of 1.7 years (9th grade level) and L3 


lariir Aaigsiiiny nag laciiikatEflj redson- 


£flwfirfl Ji LBplusKif 


UMCQ griai livelji Ini S£h grade ping ranps from LO to 3.7 yean; 


aklii rial 1 Kat'^dF SH 4 Hfl Pffiilnt' Aii frnfl ns*t 

ioiy will, piuir iQjusLiiQL on tm pirt 


vocauflUBi LcprQinaccr, 


tne Mo graae pins rrps iO to L8 yun. 


si iLuQiuti to icflOPi ana tnc uprovgienr 


sEantord fupIM acnfioli 




fif hasii fl skills- 




ft uueufc yi j Btuueiug mo win in nit prggrai Eni previoyi ynt and mo 






wire re-tested a year later indicated they lalntlinid and Improved fchiir 






pidi level mm, 




■ 



SUM 



Carter Aisessmint Prbgram, Stanford 
High School Flail Report , VQcationai 
Education Research and Planning Unit. 
Connecticut State Department of Educ- 
atlas, Hartford, Connecticut 06115* 
June 30, 1971. 



! 
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SUBJECT M 



GEM LEVEL 



Ofli intact 3rd grade 
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leuark, Mlmm 



smnsnCAL mm 



Analyels of differesei in 
Bmn gala and posttait 
mm 



mmmwm 



fcitist - posttist design usin 
triitiiDt and noa^equivilent 
prim gfoupi, 



D&MTAOTi 



tai cited 



nsnuKDRS 



Career Education Cognitive 
Queitlanisiiri 



SIZE OF SAHPU 



21 in treatment | 
23 in comparison 



CE TEEAOT 



Exposure to a CEIS eurricuiufi 
unit ever a six * week period 



mi OF §Wt 



Eviluation CQiponent; part 
d 2nd annual report * 
local liviL 
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Anilyiii of dif fereneai vithln grsups... Indicate that Chi diffidence is 
statistically signlf least at the P(iOi level: 



ion 



M 



urn 



(* t eipificaat it will beyond ,01 level) 

kilyiii of differencei in lean gain and pattest icons bitwien groupi, 
however, ii not statistically sipifieanE! 

Tteatuu ■ 2*525 \ 
CofflpariiOB ^ .696 / 1.358 

nan posttiit scores 

Ireatmt § 31,048 \ 
Coipiriapn» 29. DM / 1,367 

Analysis alio pirfonid to determine raiationship between siabgriliip in 
the treataeat or cQiparieoa groups and nan psettest scores* The 
correlation was positivi but not statisicaily signifieait; 

H4 Graded Correlation^ 



SIONS 



On the list item in the findings: How- 
ever, if the itrmgth and dinction of 
chi eorrelitian holds with the larger 
number of cases in the final evaluation 
group, the nlitionihipi bitwun lean 
posttest : wows and exposure to treaties 
will be significant, /Ho other points 
wen cite^ 



RESEARCHIR 



Riymand G, Haidyki 



SUM 



th Warty Annual Evaluation Report i 



Career Education Initru ctlonal Sjetei 



(CEIS) Project; Hrok School Mitritt, 



Ngwark, Mawiri , 1/1/75 tough 



12/31/75, Educational Tilting Sirvici, 
Pfinaatoj New Jersey 08540, n.d, 
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SUBJECT MM 



To dettraiai whether oni 
teacher's effectiveness 
iiproved after his adoption 
sf i CE oriinted approach 
« rifliEEed in aeadaiie 
Irwth of students* for 1 
year. 



UGUIOR 



Maim 



k pre-CE class wag soapind 
to a CE ciasi , 



iveient 



6th 



STATISTICAL ANALYSIS 



17* 



horn expressed n growth 
(interval) scals t permitting 
uit of piriBetrie statistical 
ill! t^tfit 



DESSIAII0N5 



none cited 

(lmm t it is questionable 
whether it is pfspir Ed aslutei 
that "iffietivineea ,i em hi 
judged on the basis of acadenic 
pDWth of student^ 



size of am 



Coipirison (1972-?3)i 24 
CE (1973-74) * 23 



CE TREATOHT 



Currieuiuffl infusion with i 
hiavy emphasis on "hands-on" 
activities* 



mi OF STDDY 



Evaluation of local CE 
prsjiQE 
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Differences between groups on the math and sources scales judged to bt 
of no significance litter from a statistical or practical point of vim. 
In reading: the greater achievement, of the CE group ii significant at 
the .023 confidence level, 



Riading Hath Sources 
son: 17, 62 39.83 32.34 



SI0N5 



These results, therefore, indicate that the 
teacher's adoption of CE activities 
appears to have affected students 1 growth 
in reading achiivimtnc during the year 
they spent with him. 



CI: 



33.58 



37.26 



33,39 



RESEARCHES 



Roy Bailey 



Career Educati on and Sixth-Grade _ 
Achieveient. New Educational Directions. 



Box 307, Crawfordsvilie, Indiana 47933. 
October, 1973, 
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SUBJECT ARIA 



LOCATION 



MM DESIGN 



SIZE OF EAfflLE 



Newark, New jersefy 



Fritist-postteat 



Mettopoiitan AehieviminE Test 



2-6*241 * mitm 
23? * math 



758*179 = reading; 
189 2 oath 



SEADE LEVEL 



STATISTICAL AMIS 




CE TREAHER 



TYPE OF STUDY 



2=fi 

?th and 8th 



To determine if the achievt- 
Bint score growth exceeded 
what would have occurred 
dui td ndml (non^progfam) 
instruction; pre-test scoria 
wire adjusted using the Bond 
Singer nthod developed by 
the New York State Education 

DppartfflMti I-test (paired 
data) 



None cited 



Technology for children; aware- 
ness in grades Hi manipulative 
hands-on activities. Guest 
speakers and parinta with a 
variety of occupations* Monthly 
workshops for prQ|rem teachers 
and administrators: 18 parent 
wfirkihops with I hands-on episode 
with related activities as they 
would occur in a elasirooifl. At 
the junior high school level 
the program focused on Introduc- 
tion to Vocations; students were 
provided with the opportunity for 
self issisesienEs of their inter 
eats and abilities and wire given 
opportunities to axploftg experi 
lent and conduct research in 
many career fields. 



Office of Carter Education 
Grant; 7/1/75 to 6/30/76 
1007502350 

Evaluation componint conducted 
by Fred Strait Associates, 
July 1976, 
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FINDINGS 



Qbjeetivi ittiinwt m poor in nading and partial In math. The 
least progress is noted in grades 3 and 6* Grade 3 showed significant 
improvisiiit In both reading and math. 



Conclusion: that CE appiari to hivt had no significant 
increaiing riading achieviDent test scores and varied 1 
level in Increasing Bath scorii: 


impact on 
pet by grade 


Grade 




Mi 






t-value/objectlvn attained 


E-valui/obj 


ictlvi attained 


2 


1.470 Ho 


4.251 


Yes 


3 


-2.642 No 


-4.194 


Ho 


4 


. -0.971 No 


2.765 


Yu 


5 


4.039 lu 


2.574 


Yes 


6 


1,795 No 




No 


Data was alio givm fsf the 7th and 8th 


grade livilei 




Grade 


t-value sipificanci 


Hath 

t-value sipificiMi 


7 


=,33 N.S, 


-3.9 




8 


-4.11 


-4.7 
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CONCLUSIONS 



..-qAth and reading ichiivtmtnt havi not 
iffiprpvidMii re-exaiinitisn iheuld be made 
of the anticipated results of such i prog- 
XM, Perhaps, attempting to achieve these 
reliiks in one program year is not rialis- 
tie, 



RESEARCHER 



Fred Stnit 



STUDY 



Carter Education Frogras, Annuil 
Report WhlL H§wirk f NewJiriey, 
1976, 
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SUBJECT AREA 



LOGATIOH 



Vocabulary ind re 
on 



GRADE LEVEL 



Kllieani San Antonio, and 
Dallas * Texas 



STATISTICAL ANALYSIS 



KIEARCH D1SIGH 



Fre-and poetCeeCi. Non- 
equivalent control group disip 
lines Tindoi aBiignient m not 
possible* 



California Achieveient Teats, 
Vocibuliry and GdipfehenslOn 

Mil thli test doel not provide 
nomtivt data for Spanish * 
speaking adults, it provides 
standard scores and grade 
equivalent score§« #«in corte - 
kting reading natarlais to 
functioning levels of 
participants 



SIZE 0? SAMPLE 



Total 

HS Control * 20 

GED Control * 20 

/ See findings for number in 
treatment groups J 



CI MAMT 



Wt OF STUDY 



Adults 



Bigressipn projection lodil 



ERIC 



This design, while not providing 
Chi clarity of interpretation 
provided by I trui txperimental 
design, does providi control 
over such sources of invalidity 
is history, niaturaEierii tiatisg 
lnstTuaentatiDn 9 silection, and 
mortality. Although the- deiign 
does limit generalizations) 
§inci external sources of in- 
validity are not controlled^ 
iuch limitatipM aft alio 
»on to its iKpirifflintal ■ 
diiign equivalent. 



Career Orientation QQuraei 15 
individualiEid, rapitiney-baiid 
moduli! on eheoiin§j gettin| s 
and keeping i job, The basic 
skills of reading, vritin| f ind 
nath computation wen intigrated 
with thus topical areas, 5 
demonstration groups of Spanish 
iufniied adults enrolled In SO 
hours of instruction* In addi- 
tion: The (teas Telaeonputir) 
Grid demonstration Qonsietid of 
kl hours of instructional and 
interact tiK> 



Of flee of Career Education 
Grant; 7/1/75 to 6/30/76? 
Grant! GO075O3401 



i 0 0 



21% 



FINDINGS 



The Career Orientation mm m found to enhance reading comprehension 
significantly in about 1/2 the iniEmtionai time used for a significant 
inereait da a high school diploma yf equivalency prsgrim, 

Results of egmpariggni were Im than definitive in that the high gehsol 
diploic treatment group reciived twice as many houn of instructions as 
project triatfflint people 



Posttest Means and Standard Deviations 
CAT; Scandard Se ores__(Achie veine-nt Divelogwt) 



Demonstration 



Vocabulary 



Reading tap. 
I s 



Phase 



1.2 
1,3 



itae II 



5 470,8 45.77 



U 



Ptsaie III 
1.6 
2.1 

US Control 

CED Control 



5 498.2 54.64 
J 482,3 49, 92 



21 516,5 62. 98 
5 519,6 55-79 



14 512,8 83,55 14 522,4 MM 

13 532,9 54,9 - - 

2D SOS J 56,16 

20 530,2 37,51 20 543,4 44,32 



Tht derived result of e (23) * =3* 243 was significant at the .001 level, 
indicating that the up of the Grid reiultid In significantly higher 
cognitive achievement than whin instruction via presented without mm 
to the Grid, 



CONCLUSIONS 



RISEARCHER 



Indication tht the interface of i&mnt T, C, Smith, Jr., Project Dirietof 
career subject matter with the basic ikills. 
was ifftetivi in reading the adult atudents, 



Thi project studies did find that inte- 
gracing occupationally relivant content 
and haaie skills enhances and facilitate 
mastery of basic skills. 



Final Project Performmse Hiport Tbbs 
Tfleeoiutir Grid/Blilnguai^|rier 
Educatign Dmstration Project ■ 
African Technological University. 
Highway 190 Vest, Kiileen, Texas* 
June 30, 1976* 
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m 



SUBJECT All 


LOCATION 


RESEARCH DESIGN 


INSTRU1NTS 


em OF SAMPLE 


Eliding and pth 


New Hiveiij GonneCEieuE 
(Troup Middle School) 


Cicy adminieCered SdhiiViiint 


Hetropgiitin AchiiVemint Test 

i 


M dearly indicated, 
ipprosimatily 100 


GMDE LEVEL 


STATISTICAL ANALYSIS 


DELIMITATIONS 


CI TRIAMT 


TYPE OF STUB! 


JfHEh (data on 8th) 


Coffipgriion cf gridi-livel 
equivileneg 


None eitid 


A pilot CI prQgfim=— included 
infuiisnj use of eommity 
nmm perssniiiij group 
visiEitioni, canir cluster 
unite (tial EiughE.) 


Local risiarch project funded 
through Connectlaut km 
Dipirtiint of Edueition - 
Division of Vocational 
Educatlgn, Research and 
Planning Unit, 
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FINDINGS 



RESEARCHER 



1 

Coipifison of 01 students at Troup tilth eta Troup studinCe^ « Chi 

average CE student scond higher thin the average student it Troup 

(the iieend average based on all Troup §tudint§ t including the higher- 
icoring CI studinti) on all nine test categories, The difference 

ranged fros two sssths to sis rathi in gradi-livii equivalence; in 

Total Reading It was four months (U vs. 5.8), in Total Hath two 
months [M vs. 6.2)* 



While these gains an modest § they are 
ceniiscint, and they luppor t the other 
Indicators of luecesSiii in my event, it 
ia modeiE but steady gains such as Chasi t 
rather thin dramatic 'solutions f , which 
hold the greatest hope for continued 
educational improvement. 

pistil Then findings and conclusioni were 
cited in correspondence frea the cosrdin- 
stof of the Mayor 1 i Task Force on Education 
to Mr, Cagllardl, 2/16/77, / 



'88 



Vincent H, Ga|liardi 



STUDY 



Career Edueition P_rp|ran_- Troup Middle 
School. Final Report, New Haven Board 
of Education. 200 Orange Street, Hew 
Raves, Connecticut, 06510, July 1,1916. 
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SUBJECT ARIA 



Unipicified 



LOCATION 



GRADE LEVEL 



Cobb County Georgia 
(4 pilot schools) 



RESEARCH DESIGN 



Aehieviiint test adminiitrition 
svir the 3 year period 



IS7KUKEBTS 



Iowa Test of Basic Skills 



STATISTICAL ANALYSIS 



3rd, 4th and 6th 
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CoEpiriaon of aein cpapoaiti 
scoria 



Unfortunately, the sahool iyitn 
dsae not have achiiveient test 
mm on ill its students, nsr 
Wife they able to tut a 
representative apple from each 
pidi level ylthln thi prsgra 
and control lehoQls* 



CE THEAIMERT 



Hi 3 yiar career divelaprjint 
program,,, use of eonunlty 
riseurcia and visitation of 
wort sices, Units i hindi^on 
aceivitlei! ill subject tie-in, 
roll pliyin|j yet of career 
diVilppsant ipteialiits, 
Nuerotii in-service Qeetings 
and workshops, Gradual expan- 
sion of project over the 3 
years. 



SIZE OF SIMPLE 



Not cited mm that "3073 
students in 115 classes wire 
involved with project 
activities which represents 
ill classes at each of the 
4 Schools" i 



TYPE OF STUDY 



Ixespliry project in vocational 
tdycition Qonductad under 
Fart D, IU 90-576 
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FINDINGS 



Results based only on the tests taken during the fall mmmi, 1972 (i.e., 
ind of 2nd year) 

M Pjg (compgre to 3,1 at tilt period) average for k project schools; 
3,3*5 * for 2 control sehsolai 345 

4thjrgdi (compare to 4,2 at [est period) average for k project schools; 
US 4 for 2 control schsgle: 3,35 

6th grade (compare to 6,2 at teat period) avenge for k project ichoolp: 
6,0 h for 2 control sehoslii 5 J 



COHCLOSIOSIS 



The information provided to the evaluation 
staff was insufficient for determining 
whether & hoc diffifenees wire significant 
It is clear that the overall means for 
project schools wen equal or higher, , 3 . 
For this mmn it is concluded that the 
objictfve m partially attained* 



[erJc 



BESEARCHER 



Evaluation Wpnlhti Douglas S. 
Mz and Robert L Morgan 

Jeil Smith, Ffojact DiraeEor 



STUDY 



A Deveiapniental Program of Occupational . 
Eduegtlon , Final Report , Cobb Count™ 
Boird of Education. 47 Widdell Street • 
Marietta, Georgia, 30062, 1970-1973, 
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SUBJECT AREA 



spelling, math 



LOCATION 



Fittibtirg* Kansas 



RESEARCH DESIGN 



GRADE im 



pritiit * poittest, experimental 
and control group (a 3rd and 
6th gride of a parochial ichool 
which did not have career 
education* j 



STATISTICS AMLYSIS 



DELIMITATIONS 



3rd 
6th 
9th 



Chi=square procedure 



See 3rd year Evaluation 



ZHSRDHHTS 



Metropolitan Achievestnt Tests 
II patt of Eeplir evaluation 
program) 

9 itibtesti (3rd frada) 

11 Subtisti (6th gridiS 

ABLE test, used in career math 
class (in which students implore 
ways math ii related to 
occupations,) 



SIZE OF SAMPLE 



CE TREATMENT 



2nd year i 

rap ; 203 * 235 in 
3rd gradt 
experimental 

range ; 231 - m in 6 th 
grade experimental 

64 in pretest # 
54 in posttsst in 
9th grade 

In Control: 

26 in 3rd 

30 in 6th 



Pfogram activities i I - week 
institutes at two colleges, 
1-wiik institute on syitini analy- 
sis for ourriculum change, 1-day 
institute for all staff, con- 
sultants working with tiicherif 
evening and weekend eouriii for 
staff, special workshops, career 
education components into curri^ 
C'dum, continuid Staff planning, 
begin devilopment of printed 
currieuluffl guides* 

Carter Mathematics h a segment 
of Qimt education, Raiourci 
prsons who uat math in occupa- 
tions in used extinsively 
(8th and 9th grades) 



Iff E OF STUDY 



Evaluation compontnt of 
thi ixemplafy projict in 
vocational education 
conducted under Part D 
Of F.L. 90-576. 

(2nd year evaluation 
5/74 * 4/75) 



FINDINGS 


CONCLUSIONS 


RESEARCHER 


2nd year evaluation! 9/74 to 4/75 

Fosttest scores (3rd gradi) showed a substantial gain over the pri=te§t 
icons in all 9 tests, a distribution of frequency, * .compiled ind tested 
for significant differencist the difference in Frequeney lignifieant 
at the; .DPI level on all 9 teats. Conipariion between groups; no 
.statistical difference between experirngntal and control, 


2nd. year u.the (program) has neither 
enhanced nor inhibited the traditional 
learning process at grade! 3 or 6« There 
was substantial growth in all 9 anas 
shewn by pre- and posttest in both grades, 


David L, Huffman 


6th grade data: In the teste j or m $ knowledge and language, the 
distribution of scores was not statistically significant The other 
nine tests were statistically significant at the ,05 or higher level of 
confidence; 6 of the tests were significant at the Ml level (reading. 
Spelling, math computation, problem solving, total math, science,) No 
significant differences betwgin the exDirimental and rnntml ftrnine 




■ 


9th grade data: difference between pretest and post-test distribution 

^tuitj »£ii3 Jiyjtit iLant ul iUUI its* 1 .'! Ql CQnt iQliflG^ i 




._ 






STUDY 






Sec 3rd year Evaluation 



SUBJECT TEA 



/ lag as indicated in 2nd 



LOCATION 



GRADE LEVE 



STATISTICAL ANALYSIS 



3rd 

6th 
8 th 



8 

o 
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RESEARCH DESIGN 



DEMTATIQNS 



re. 3rd year 

,thi selection of thi Control 
Group t a Catnqiic school in 
Pittiburg^ wai not a valid is- 
liction is many of their teachirs 
were involved in our in-servici 
activitiii which did expoie thtir 
students to many of the same con 
eepts as thoie studtnts in the 
public schools * Alio, the ix* 
eillent news coverage we have in' 
joyad lisp sirved to in^iirviei 
many teaohiri in thi aroa teach- 
ing in other school districts. 
Thii wis good to prss^te oifiir 
iducatigfl* but very poor whin it 
tm to electing a control 
group for proper evaluation, 
/Jn correipondinci from David 

^ Huffman, Assist. Supt * and 
Career Edueation Director, 
12/30/76/ 



INSIEOMHIS 



SIZE OF SAMPLE 



3rd year i 

range i 215-249 in 3rd grade 
expirijuantal 

range i 240-270 in 6th grade 
experimental 

62 in pretest, 56 in 
poitteit in 8th 
grade 

In Control; 26 in 3rd 
30 in 6th 



CI TREATMENT 



TYPE Of STUDY 
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FINDINGS 


CONCLUSIONS 


RESEARCHER 


3d yiir evaluation? 9/74 to 3/76 


re: 3rd yeir --- 


David L. Huffnian 


Resyitl of pogttegt icoris in 3rd gradi indicated a subiUntial gain over 
prttess icons in all 9 ireas f t .statisticiily, thi diffirinee in frequency 
between priest and posttiit was significant at ,005 level in all 9 ireai; 
no statistical difference between experimanbal and control, 

Eth grade data; no statistical significance betwien scores of 2 groups. 
Results indicate substantial growth in all 11 areay, 

3th grade datai career math program had positive effect oil the performance 
of studonti* 


lM we could not show sifnificant difference 
front thi control group* but we did show 
continued growth in aehieveingnt as ihould be 
expected and also have included many 
artivitiei that promoted awareness, ex- 
ploration and preparation including 
deeision-miking skills, / David L Huffnian , 
12/30/76/ 








SIM 




■■■ 


A Consortium Approach to Exemplary 
Career Education program Divilop- 
pnt Involving Two Unified School 
Districts and Two Ttasher Educa- 






tion Institutions, Unified SchodL 
District #250, Pittiburg# Kaniis ? 
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SUBJECT AREA 



Determine whiEhir teachers 
who uii pre=designed f self- 
Bade esnctpiualiiid GE 
Curriciiluffl could effect 
Significant academic 
MiLh 
Seiince 
English 
Social Studies 



LOCATION 



RESEARCH DESIGN 



Klnsas 



Pre and poitEest 



INSTRUMENTS 



4 iuhtests froi advanced 
complati battery, Itinferd 
AchievemenE Tut 



SIZE OF SAW 



Experimental = 235 
Central » 134 



GRADE LEVEL 



8th 



202 



STATISTICAL ANALYSIS 



DELIMITATIONS 



CE TREATMENT 



TOE OF STUDY 



2 - way analysis of varianst 
applied to pretest data* 
Postteit fflinua Che pretest 
for tach subject vas isamine* 
using hmy analysis of 
csvariincg on the differenci 
icon adjusted for the pre- 5 
test, 



Non*i cited 



20 teachers and adffiinistritors 
riciivid 2 weeks of extensive: • • ' 
in*se-3fvice workshops (summer of 
1974); in-sirvlQi {raining once 
a month; CI curriculum models 
wirt designedi ? souths 
impliffiinting in actual classes. 



Ristaf ch by SID but ns 
Indication of where in 
the state it occurtd 
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GOMCLUSIOHS 



RtsuU did not provide i significant F-fitio; no significant difference 
in fflath 9t English achievencnt. 



Control Tfpahiipfir 


f f etlO 


Probability 


HUh peepta 


1,3 


, NS - 


0.258 




0.4 


US- 


0.521 


Math applications 


0.7 


RS« 


o,™ 


Ungmgi 


6.07 


85- 


0.791 



Thert existed a significant intaradtien effect fei social science 
in the 7th gride. Treatment population did significantly iittif 
Ehafi control! F-ratio; U 
Signfi 0,039 

Significant differences between both 7th and 8th grade science treatunt 
and control groups, loth treatment groups did significantly better: 

F-ritloi 5,7 
Slgef.; 0,017 



ipointid out that the 7th grade treatment 
group should a hightr adjusted mm differ* 
enct score on ill variable except sath 
concept and both 7th and 8th treatment 
populations did show increase from pre to 
post tests. The EE tteitMnt certainly was 
not debilitating.. , findings not too surp- 
rising when one considers the less expiri- 
sental nature of (scadiffiic} disciplines 
vis-a-^is social science and science (which 
ire iore experiiintal and hands-on type of 
instruction} !M then reasons account for the 
dichotomy of icorii Insofar ai levils of 
significance,.. feal that in a statistical 
is well as in icidiaic senae p 0E his proven 
to hi a iucciSi in our tKperimant# 



RESEARCH! 



Gordon R, Schulti 



204 



STUDY 



The Relationship Between Conceptualised 
for Carter Education Teachers 



and_ (1) Vocational Maturity; (2) AcadiBic 



Achievement In A Select Number of 



nesjor Seventh and Eight, Grade 



Students^ Office of Exemplary and 



Special Niids, Kansas State Dapirtsiat 
of Education, Topika, Kansas, 66612, 
n. di 
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LOCAOT 



The basic skill objective: 
Che linim pirfownci 
objectives developed by the 
Hichigan Pepirtnent of 
Education In Chi area of 
Hath, 



Calhoun County, Mason, 
Hichigan 



SMI LEVEL 



STATISTICAL AMIS 



mmm mm 



INSTRMfJ 



Pri- posttest 



Locally developed instruitflti 



DEMTATISHS 



CE TKMjffl 



SKI OF SAHPLI 



Exp, = 3rd i 4th * US 
5th * 103 

Control - 3rd k 4th =207 
5th ^ 141 



STUDY 



3rd, 4th and 5th 



Coaparlaon of pre- posttest 
mm 



A "validation process 11 to 
deteraine the pBtintiaiity of 
of integrating CE perfqrainci 
objectives with biiie academic 
objiativii in instruction. 



The Staff has 'ixperilentid with 
varipui approachis mi technique! 
to fifini and inhanei the service 
that yai diviioped for thi Cal 
houn County ana, 1 



Rtport of county pfojtet 



33A 



ERIC 



5th grade ■ H» eentintion asserted that mimic achiiviisnt muld not be 
impeded as j rtiult of Gl Instruction, ..the experifflintil students per- 
fon«d at halt as veil., *oo the oath section, 

3rd and 4th gridis - The muitipiicicioti lection m m difficult for 
iiEhir group - with little or w changi pre and dose. For thi other itens 
(addition, angli^ fractions* notation* points and lines, division) there 
wii only slight dif f irincts. . .supporting thi hypotheBls that acadeaic 
compeCenCG (maisurid ^y a math test) would not be impidid as a result of 
creatinine. 



CONCLUSIONS 



5th grade - Certainly, thi iacegraced 
approach does not interfere with mimk 
learning ..of students ixpssid to this kind 
of treatment* In son instances achieve* 
oianc [My hi inhmcid by this approach, # t , 

3rd and 4th grades * Academic skills are 
not greatly inhaneed by the integrated 
currieylHj but certainly the approach 
does 8 not interfere with atudent learning, 
(However) not only can it provide thi 
essential basis skills at the sail level 
ai traditional teir-hing^ it diliveri other 
information ind knowledge that normally ii 
not provided in the litter approach. 



'RESEARCHER 



1* Sifflpaon 



STUDY 



An Assessment of Thi Effects of 
Integrated Curriculum on Students 
jn_ Calhoun County .' 1973-74, 611 ~ 
Hagadorn Road s Mason, Hiehigin 48854. 
n.di 
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SUBJECT AM 



Reading ind mathematics 



GRADE LIVE 



8th and 9th 



LOCATION 



Dade County, Florida 



STATISTICAL AttLtiti 



Analysis of tniin total 
icon remits 



MSEA1CH DESIGN 



Norm-feference result, 
to results previously attained 
in 1974-75, Additional 
evaluations it junior high leveL 
9th grade itudinra whs partici- 
pated in eareeMelated lan- 
guage ana wire Pitched with 
those who did not participaCi ! 
(intirns of reading aehiiveEint) 



IONS 



(1) the sin of tit sample. i* 
while not large (V m Prob- 
ably reliable, HowiVtr, not 
all tests and not ill schooli 
win matriF'sampled (wherein 
each Student receives only a 
partion of the test J (I) With 
reipeet eg the prier-related 
language arts study; difficulty 
in matching pupils, (3) Problem 
of cine required for prpper 
ifflplMentatisn of a program, 



Elementary level: non-referenced 
tut of carter awareness (but 
data was not given.) Alio (1) 
Florida State Assessment of 9th 
grade reading skills win com- 
pared; (2) Florida 8th Gridi Test 
used to compafe results to Other 
county schools and stati-wide 
averages in language arts ,math, 
and occupational information. 



SIZE Of SAMPLE 



Pilot and comprehensive 
school career exploration 
students in 8th grade: 
reading - 2,158, math § 
2,18)1 9th grade! treatment 
and control groups = 294 
each, 



CE-TREAIMEHT 



Elemintiry school (career 
awareness) directed at providing 
relevancy to basic skills by 
showing practical application to 
job skills, Cosponint; individ- 
ual "hands-en" stations, mater- 
ials, hardware, occupation 1 ! 
clothing M.ielHnstructioni 
learning activity packages, 
Junior high school: 8 career 
clusters, elective career 
ploratory lab cdurgei»M l! Ery s On !l 
experiences in various eccupa- 5 
tions, Gareer^related language 
arts and nth as alternitivei to 
traditional instruction i 8 
language arts and 4 math career* 
related "quins" include individ- 
ualized learning activity pack- 
ages and related "hands-on 1 ' 
experiences, 



TYPE OF STUDY 



Dade County evaluation 
project 
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CONCLUSIONS 



RESEARCHER 



Acquisition of reading skills sgmewhac higher for CE group, Florida 
Statewide Teit results higher than county and state averages in math.. 
Results of Florida 8th and 9fch grade tests ihgwed achievement in basic 
skills of nth and reading (language arts) win being clearly hut not 
spectacularly Impacted by CE program, In math, ths (junior high) 
school! not only aurpisiid average results in county out wen higher 
than ititi average; the reading outcome wis higher than county but 
lover than state average. 



Based on current trends bath elementary 
and junior high program My be expected 
to produce.. .related achievement in the 
basic skills which will likely surpass 
state and national norms for many schools 



None cited (Report prepared by Dade 
County Dipartnint of Planning and 
Evaluation, 



STUDY 



Evaluation of Dade County Public School 
Career Education Pnigrm, 
Department of Planning and Evaluation. 
Eade County Public Schools. 1410 E,E. 
Second Avenue, KM, Florida, 33132, 
July, 1975, 
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SUBJECT AREA 



LOCATION 



ESI 



To establish ezperioental 
tnd control groups of student 
to test if ftetivenesi of CE 
paekagig, 



Erie County^ to York 



GRADE LEVEL 



Varied as m test; ineludtd 
HI overall. 
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1 STATISTICAL ANALYSIS 



Meet for indepei 
samples win used to uiiaiure 
achlivisint dlf firencts . 



Expertontil ^ sections taught 
by imhn who devtlopid CEIS 
curriculum packages or who hid 
training in their use; control 
no,pfior training In use or 
devildpiQiflt of packages. . , . 



poittiit CEIS inetru- 



oiinti 



DiLlMITATlQNi 



(Listed under conclusions) 



INSTRIMNTS 



Thi critirien - referenced CEIS 
instraents - written to natch 
objective! in OE packages i 



CE THMMENT 



Not indicated as such, /Note; 
However, another isurci (CEIS 
Thru Yiar Frsjaot Suanary— 
same address as Phase III 
indicated that 100 teachers, 
cduniilarii adniiniitratsri and 
media specialises were oriented 
ar . trained to prepare curriculum 
packages in language artSj math, 
iciinCBi and social science at 
all gride levels, 52 Liirnlng 
Activity packiti wire prepared. 
Following suKf orientation, 
300 teacher s used then in -their 
classrooms J 



SIZE OF Mil 



Varied froB grade to grade, 
but usually lies than 10 In 
ixperimentai and control, 



TYPE OF STOW 



Field testing of curriculum 
materials designed to infuse 
concipti into the nopal 
acideiic curriculum * local 
level* 



Fires 



SIGNS 



Mi Mivi trnmu mm eouU net be deionstratid, bath groups 
snowed lebievmeoc gain, almost wlchout tKeeption, betwua pce*and post- 
Wj. Furthifflsri, in atat 2/3 (6UZ) 0 f the cases, the Hesti " 
»Mcn wre pirforiid vgrg statistically significant, 

/fetes Bryant 3 reported the following data foi Ehe 1st year of the protect 
pre-post testing indicted slight gains in 28 test cells (grade levei- 
iubjict) for which diti wire obtainid; 2 eases wire itatiaticaily slgnif- 
eant in achievisent gains during the 1st year of field testing. During 
he 1974-75 year, n*Wm of the pr^post testing indicated inemaL 
in « ieviient in ill hut 5 of the C4 Eest ceils. In 16 cans the pine 
iipfrlfflintil over control, wire atatteticaily significant./ 



The failure to produce an extensive 
itadstieiUy significant ichieviiint 
diffirintial,,,can result from a variety 
of factors! the statistical ptaumeW of 
regression, failure to latch treatment 
groups on all relevant variables, and 
ceiling effects.. .iiapossible to produce a 
truly equivalent control group design due 
to lack of eoDpIete hatching. 



BESEUOER 



Malcolm Conway, External Evaluate 



lis 



I let 



STOW 



Career 

Phase III, Final Report. 1974-75. 
Board of Cooperative Educational Services, 
First Supervisory District. Erie County. 
^Cayuga sd M Chiiktowaga, NJ. 14225 
duly 11, 1975, 
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SUBJECT ARIA 


LOCATION 


RESEARCH DESIGN 


INSTRUMENTS 


SIZE OF SAKFLE 


tadlng and mathematics 


Hist Virginii 


Pri-and posfctest 


Metropolitan Achievement Tests 


Expertatd - 20 
Control ■ 20 


GRADE LEVEL 


STATISTICAL ANALYSIS 


DELIMITATIONS 


CE TMAMNT 


TYPE OF STUDY 


4th and 5th 


t-EiSt 


A field studyi lack of 
control of the ixpeUiental 
itation 


One group (ixperimental)had hien 
inrsilid in a CI progras for 3 
years. 

/Note i not such information was 
prtsentid other than it wai 
letabliihed that i wiak of In- 
service training preciaded 
monthly iftirichosi planning 
and iipliiintation of CE units./ 


Doctorii dissertation 

« 

■ 
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FINDINGS 



No statistically significant differences between the gfoupi in level 
of reading achievement in gridn 4 (t , 22) p 5(t,32), or between school 
caiprUons or in mth achievement between the 2 fourth grades (E , 08) , 
the 2 fifth grades (Ul) or between schools (t ,15) cofflparlsens. 



CONCLUSIONS 



,,,the cpneiuaion would fee that there are 
severe limitations on the choice of sea- 
suring devices for career developient; m 
since our knowledge of carter developiint 
is limited at the present time, in ade- 
quate evaluation of CE or carter develop- 
lent is not possible* 



RESEARCHER 



Stephen S« Felt 



STUDY 



Career Education and Its Impact on 
Academic Achiivnent md Ciriir 



Dgvtlopient . Unpublished Ed, D. 
dissertation. Wist Virginia University* 
Horgantownj Wise Virginia * 1973, 
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SUBJECT AREA 



Reading and math 



LOCATION 



Rugion 10 

Education Sendee Center 
Richardson Texas 

(4 local districts) 



RESEARCH DESIGN 



Pre=and post-measures 



GRADE LEVEL 



It apparently varied from 
K to U 



STATISTICAL ANALYSIS 



Control groups not used,** 
however, i tichniqua whireby 
each Student served as his/her 
own control m tiplpyidii.a 
Pre "Intervention Growth Date 
for each student was calculi* 
ted and later used as baseline 

dm.,.* 



DELIMITATIONS 



The intervention period during 
which student instruction was 
provided wai liiited to a fflix- 
imum of 12 weeks, 



INSTRUMENTS 



Comprehensive Teat of Basle 
Skills 



SIZE OF lAfffLE 



CE TREATMENT 



Phasing in CE Systematically 
Project: specific instructional 

planning based on 2 data ceo- 
tefed systems (sequencing and 
needs assessment.) 

Two phases; preparation and , 
instructional application. The 
toer included priintationj 
sequencing learner outcomes, 
needi assissnintt isd instruc- 
tion piannini; the latter 
included instruction in opera* 
tiotii follow-up consultative 
assistance, and reporting • 



Reading a 449 
Math - 409 



TYPE OF STUDY 



Office of Carter Education 
Grant! 7/1/75 to 6/30/76 
Grant#G007503740 
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FINDINGS 



2 

The t value resulting from the analyiii was found to be bilow the value 
required for significant at the .05 level. However , it was noted that: 
lore students had negative iigns than had poiitive signs, 



CONCLUSIONS 



1 >f 



on itudint growth ntea: 








Reading s 








Positive 


Negative 


i 


Expect id 


124.5 


224,5 


3.764 


Observed 


211 


231 






Math - 








Positive 


negative 






204,5 


204.5 


3.719 


Observed 


m 


185 




tavifr 


In. math, out of 


the 409 students mM % 39 sier 


positive 


than negative s 


ips were obi 


irvid. 



The inpaet of the prejiet in terms of 
Producing significant cepitive.*. gains 
ifflongii. students was found to be neglig- 
ible, / sic / 



RESEARCHER 



Swyn Brownlee, Project Director 



STUDY 



Fhiiing in Career EdueaHm 
jyetegiaticall^Rggjnii 10, ""Education 
Service Center. Riehirdaonj Texas* 
Siptisbtr, 1976, 
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SU1JKI AREA 



SuMitivt iviluation en 
achigvizaenE 



GMfil LEVEL 



lit to 9th 



226 



LOCATION 



Hinnisoti (7 projects 
eval 



STATISTICAL AmYIII 



Descriptive statistics; 
frequency! Etini, stindard 
deviations, Hoyt f e riiiabll- 
ity coefficient, percantsgai. 



RESEARCH DESIGN 



Ixperisental and control 
groups 



lose 



Two types; The way in which 
populitisna wire identified 
and test validity and reliabil- 
ity, Tha tilts wen equally 
reliable for both groupi but 
the 4-6 and H tests were more 
reliable thin the 1-3 test* 



ZHSTRMEIIIS 



Specially developed tests. m to 
mm impact of CE on copitive 
aehieviaints. 



CE T1ATHENT 



Hot specified other than that 
it dealt with avareness (Hh 
iwiriniii and orientation 
6), and exploration (7-9) • 

/Notes Implication that 
= activitiii included insifvico 
traininij use of different 
curriculum or institution • 
aatefiilij and guidance ear- 
vices i / 



SHI OF SAMPLE 



B048 defined as experiientali 
2853 as control 



mi OF SOT 



Final report of the 
ixiupiary pfoirams.il 
funded under Part 0 of 
Vocational Education 
Amendments of 1968* 
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FINDINGS 


CONCLUSIONS 


RESEAkiHER 


Differences in student achiiviiant win detected for experimental and 
control groups, but these difference wire small and not always in favor 
of the ixpifiEintal groups, 

Scudtntg in isperimental projeet tandid Co have slightly higher mean 
scorn on 1-3 and 4-6 tests; students in control groups tended to have 
higher mean score on 7-9 test. Differences for 1-3 teat quite small; 
considerably larger for H and 7-9 tests. 

Data iuggist g trend for experimental students to score highir on 1-3 
mil §1 of comparisons wire in favor of expiriaentil groups. In thi 
W East; only 482 of comparisons favored iKperimental groups, 

hu not presented for 7-9 test because of limited nusfe of comparisons* 

ft 

■ 
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It stems safe to conclude that the impact 
was Qinimal, 

Four explanations: possibility tuts did 
not adequately sample the content impha- 
sized by tiachers in exemplary projects; 
teachers in control echooli had perhaps 
been teaching g£ concepts; inadiquati 
amount of instructional eiapbaais and tine 
(1 1/2 hrs, per wed); one year of CE 
instruction may be ineuf ficitnt , 


Brandon B, Smith 


STUDY 

A Systii For Evaluating Career 


Education in Minnesota! 1972-7JL 


Minnesota Riseareh Coordinating 
Unit for Vocational Education, 
University of Minnesota* Minneapolis 
Minnesota! 55455, January* 
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